2023-10-02 09:02:22,230 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-02 09:02:22,460 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0 2023-10-02 09:02:22,460 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-02 09:02:22,460 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-02 09:02:22,496 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-02 09:02:22,721 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-02 09:02:22,721 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b, deleteOnExit=true 2023-10-02 09:02:22,722 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-02 09:02:22,722 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/test.cache.data in system properties and HBase conf 2023-10-02 09:02:22,723 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop.tmp.dir in system properties and HBase conf 2023-10-02 09:02:22,723 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop.log.dir in system properties and HBase conf 2023-10-02 09:02:22,723 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-02 09:02:22,724 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-02 09:02:22,724 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-02 09:02:23,065 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-02 09:02:23,070 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-02 09:02:23,071 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-02 09:02:23,071 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-02 09:02:23,071 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 09:02:23,072 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-02 09:02:23,072 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-02 09:02:23,072 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 09:02:23,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 09:02:23,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-02 09:02:23,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/nfs.dump.dir in system properties and HBase conf 2023-10-02 09:02:23,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/java.io.tmpdir in system properties and HBase conf 2023-10-02 09:02:23,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 09:02:23,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-02 09:02:23,075 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-02 09:02:23,621 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-02 09:02:23,626 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-02 09:02:23,974 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-02 09:02:24,154 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-02 09:02:24,168 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 09:02:24,208 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 09:02:24,244 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/java.io.tmpdir/Jetty_localhost_37555_hdfs____y67oez/webapp 2023-10-02 09:02:24,405 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37555 2023-10-02 09:02:24,416 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-02 09:02:24,417 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-02 09:02:24,914 WARN [Listener at localhost/44077] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 09:02:24,992 WARN [Listener at localhost/44077] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 09:02:25,015 WARN [Listener at localhost/44077] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 09:02:25,076 INFO [Listener at localhost/44077] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 09:02:25,085 INFO [Listener at localhost/44077] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/java.io.tmpdir/Jetty_localhost_44521_datanode____bf6rh7/webapp 2023-10-02 09:02:25,185 INFO [Listener at localhost/44077] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44521 2023-10-02 09:02:25,651 WARN [Listener at localhost/45931] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 09:02:25,665 WARN [Listener at localhost/45931] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 09:02:25,668 WARN [Listener at localhost/45931] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 09:02:25,671 INFO [Listener at localhost/45931] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 09:02:25,679 INFO [Listener at localhost/45931] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/java.io.tmpdir/Jetty_localhost_37781_datanode____yfu0kz/webapp 2023-10-02 09:02:25,786 INFO [Listener at localhost/45931] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37781 2023-10-02 09:02:25,799 WARN [Listener at localhost/34283] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 09:02:25,852 WARN [Listener at localhost/34283] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 09:02:25,855 WARN [Listener at localhost/34283] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 09:02:25,857 INFO [Listener at localhost/34283] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 09:02:25,872 INFO [Listener at localhost/34283] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/java.io.tmpdir/Jetty_localhost_46617_datanode____.1aa77j/webapp 2023-10-02 09:02:25,992 INFO [Listener at localhost/34283] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46617 2023-10-02 09:02:26,007 WARN [Listener at localhost/38499] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 09:02:26,252 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8ea064356b048ffc: Processing first storage report for DS-7754ce7e-a694-441b-ac6c-c59419aa904d from datanode a00f7a5a-a98a-48cf-99ff-77b9714fd031 2023-10-02 09:02:26,255 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8ea064356b048ffc: from storage DS-7754ce7e-a694-441b-ac6c-c59419aa904d node DatanodeRegistration(127.0.0.1:44669, datanodeUuid=a00f7a5a-a98a-48cf-99ff-77b9714fd031, infoPort=38723, infoSecurePort=0, ipcPort=45931, storageInfo=lv=-57;cid=testClusterID;nsid=851305158;c=1696237343724), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-02 09:02:26,255 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x561f681e252ab103: Processing first storage report for DS-2ee10f03-2992-4fc6-9669-aac83168784a from datanode d78f62f4-c9aa-4a2e-a1d0-98a782557ed0 2023-10-02 09:02:26,255 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x561f681e252ab103: from storage DS-2ee10f03-2992-4fc6-9669-aac83168784a node DatanodeRegistration(127.0.0.1:37285, datanodeUuid=d78f62f4-c9aa-4a2e-a1d0-98a782557ed0, infoPort=40393, infoSecurePort=0, ipcPort=34283, storageInfo=lv=-57;cid=testClusterID;nsid=851305158;c=1696237343724), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-02 09:02:26,256 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5145f9cb91f18407: Processing first storage report for DS-5f610856-6526-4177-a21b-b4666e444a8c from datanode 45ed5355-36b6-4719-8442-9382409ece71 2023-10-02 09:02:26,256 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5145f9cb91f18407: from storage DS-5f610856-6526-4177-a21b-b4666e444a8c node DatanodeRegistration(127.0.0.1:37907, datanodeUuid=45ed5355-36b6-4719-8442-9382409ece71, infoPort=35651, infoSecurePort=0, ipcPort=38499, storageInfo=lv=-57;cid=testClusterID;nsid=851305158;c=1696237343724), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 09:02:26,256 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8ea064356b048ffc: Processing first storage report for DS-d110998f-17c5-405a-82f0-c5ee2b82afb8 from datanode a00f7a5a-a98a-48cf-99ff-77b9714fd031 2023-10-02 09:02:26,256 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8ea064356b048ffc: from storage DS-d110998f-17c5-405a-82f0-c5ee2b82afb8 node DatanodeRegistration(127.0.0.1:44669, datanodeUuid=a00f7a5a-a98a-48cf-99ff-77b9714fd031, infoPort=38723, infoSecurePort=0, ipcPort=45931, storageInfo=lv=-57;cid=testClusterID;nsid=851305158;c=1696237343724), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-02 09:02:26,256 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x561f681e252ab103: Processing first storage report for DS-1fdd2da1-9422-467a-8f50-08c8784fb517 from datanode d78f62f4-c9aa-4a2e-a1d0-98a782557ed0 2023-10-02 09:02:26,257 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x561f681e252ab103: from storage DS-1fdd2da1-9422-467a-8f50-08c8784fb517 node DatanodeRegistration(127.0.0.1:37285, datanodeUuid=d78f62f4-c9aa-4a2e-a1d0-98a782557ed0, infoPort=40393, infoSecurePort=0, ipcPort=34283, storageInfo=lv=-57;cid=testClusterID;nsid=851305158;c=1696237343724), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 09:02:26,257 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5145f9cb91f18407: Processing first storage report for DS-acbb377e-21fe-4824-ba7e-57991d1979d8 from datanode 45ed5355-36b6-4719-8442-9382409ece71 2023-10-02 09:02:26,257 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5145f9cb91f18407: from storage DS-acbb377e-21fe-4824-ba7e-57991d1979d8 node DatanodeRegistration(127.0.0.1:37907, datanodeUuid=45ed5355-36b6-4719-8442-9382409ece71, infoPort=35651, infoSecurePort=0, ipcPort=38499, storageInfo=lv=-57;cid=testClusterID;nsid=851305158;c=1696237343724), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 09:02:26,496 DEBUG [Listener at localhost/38499] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0 2023-10-02 09:02:26,598 INFO [Listener at localhost/38499] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/zookeeper_0, clientPort=60549, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-02 09:02:26,618 INFO [Listener at localhost/38499] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60549 2023-10-02 09:02:26,629 INFO [Listener at localhost/38499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:26,631 INFO [Listener at localhost/38499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:27,340 INFO [Listener at localhost/38499] util.FSUtils(471): Created version file at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 with version=8 2023-10-02 09:02:27,340 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/hbase-staging 2023-10-02 09:02:27,756 INFO [Listener at localhost/38499] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-02 09:02:28,255 INFO [Listener at localhost/38499] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 09:02:28,289 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,289 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,290 INFO [Listener at localhost/38499] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 09:02:28,290 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,290 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 09:02:28,436 INFO [Listener at localhost/38499] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 09:02:28,509 DEBUG [Listener at localhost/38499] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-02 09:02:28,604 INFO [Listener at localhost/38499] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39745 2023-10-02 09:02:28,617 INFO [Listener at localhost/38499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:28,619 INFO [Listener at localhost/38499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:28,644 INFO [Listener at localhost/38499] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39745 connecting to ZooKeeper ensemble=127.0.0.1:60549 2023-10-02 09:02:28,700 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:397450x0, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 09:02:28,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39745-0x101065f16b50000 connected 2023-10-02 09:02:28,736 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 09:02:28,737 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 09:02:28,750 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 09:02:28,758 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39745 2023-10-02 09:02:28,759 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39745 2023-10-02 09:02:28,759 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39745 2023-10-02 09:02:28,760 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39745 2023-10-02 09:02:28,761 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39745 2023-10-02 09:02:28,767 INFO [Listener at localhost/38499] master.HMaster(444): hbase.rootdir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247, hbase.cluster.distributed=false 2023-10-02 09:02:28,837 INFO [Listener at localhost/38499] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 09:02:28,837 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,837 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,837 INFO [Listener at localhost/38499] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 09:02:28,837 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,838 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 09:02:28,842 INFO [Listener at localhost/38499] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 09:02:28,846 INFO [Listener at localhost/38499] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39697 2023-10-02 09:02:28,848 INFO [Listener at localhost/38499] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 09:02:28,855 INFO [Listener at localhost/38499] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 09:02:28,856 INFO [Listener at localhost/38499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:28,858 INFO [Listener at localhost/38499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:28,861 INFO [Listener at localhost/38499] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39697 connecting to ZooKeeper ensemble=127.0.0.1:60549 2023-10-02 09:02:28,865 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:396970x0, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 09:02:28,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39697-0x101065f16b50001 connected 2023-10-02 09:02:28,866 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 09:02:28,867 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 09:02:28,868 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 09:02:28,869 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39697 2023-10-02 09:02:28,870 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39697 2023-10-02 09:02:28,870 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39697 2023-10-02 09:02:28,872 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39697 2023-10-02 09:02:28,872 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39697 2023-10-02 09:02:28,884 INFO [Listener at localhost/38499] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 09:02:28,885 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,885 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,885 INFO [Listener at localhost/38499] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 09:02:28,886 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,886 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 09:02:28,886 INFO [Listener at localhost/38499] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 09:02:28,887 INFO [Listener at localhost/38499] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40077 2023-10-02 09:02:28,888 INFO [Listener at localhost/38499] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 09:02:28,889 INFO [Listener at localhost/38499] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 09:02:28,890 INFO [Listener at localhost/38499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:28,892 INFO [Listener at localhost/38499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:28,894 INFO [Listener at localhost/38499] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40077 connecting to ZooKeeper ensemble=127.0.0.1:60549 2023-10-02 09:02:28,900 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:400770x0, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 09:02:28,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40077-0x101065f16b50002 connected 2023-10-02 09:02:28,902 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 09:02:28,903 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 09:02:28,904 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 09:02:28,904 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40077 2023-10-02 09:02:28,905 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40077 2023-10-02 09:02:28,905 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40077 2023-10-02 09:02:28,910 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40077 2023-10-02 09:02:28,910 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40077 2023-10-02 09:02:28,922 INFO [Listener at localhost/38499] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 09:02:28,923 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,923 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,923 INFO [Listener at localhost/38499] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 09:02:28,923 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 09:02:28,923 INFO [Listener at localhost/38499] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 09:02:28,923 INFO [Listener at localhost/38499] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 09:02:28,925 INFO [Listener at localhost/38499] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44871 2023-10-02 09:02:28,925 INFO [Listener at localhost/38499] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 09:02:28,926 INFO [Listener at localhost/38499] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 09:02:28,927 INFO [Listener at localhost/38499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:28,928 INFO [Listener at localhost/38499] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:28,930 INFO [Listener at localhost/38499] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44871 connecting to ZooKeeper ensemble=127.0.0.1:60549 2023-10-02 09:02:28,934 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:448710x0, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 09:02:28,935 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): regionserver:448710x0, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 09:02:28,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44871-0x101065f16b50003 connected 2023-10-02 09:02:28,936 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 09:02:28,937 DEBUG [Listener at localhost/38499] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 09:02:28,937 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44871 2023-10-02 09:02:28,941 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44871 2023-10-02 09:02:28,941 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44871 2023-10-02 09:02:28,941 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44871 2023-10-02 09:02:28,942 DEBUG [Listener at localhost/38499] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44871 2023-10-02 09:02:28,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39745,1696237347579 2023-10-02 09:02:28,954 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-02 09:02:28,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39745,1696237347579 2023-10-02 09:02:28,974 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 09:02:28,974 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 09:02:28,974 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 09:02:28,974 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 09:02:28,974 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:02:28,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-02 09:02:28,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39745,1696237347579 from backup master directory 2023-10-02 09:02:28,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-02 09:02:28,983 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39745,1696237347579 2023-10-02 09:02:28,983 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-02 09:02:28,984 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 09:02:28,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39745,1696237347579 2023-10-02 09:02:28,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-02 09:02:28,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-02 09:02:29,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/hbase.id with ID: af07caa6-7e7a-441d-aee8-88438dcbd9e7 2023-10-02 09:02:29,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 09:02:29,149 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:02:29,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x56d91bb7 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:29,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e96f782, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:29,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-02 09:02:29,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-02 09:02:29,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-02 09:02:29,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-02 09:02:29,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-02 09:02:29,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-02 09:02:29,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 09:02:29,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/data/master/store-tmp 2023-10-02 09:02:29,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:29,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-02 09:02:29,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 09:02:29,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 09:02:29,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-02 09:02:29,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 09:02:29,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 09:02:29,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 09:02:29,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/WALs/jenkins-hbase4.apache.org,39745,1696237347579 2023-10-02 09:02:29,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39745%2C1696237347579, suffix=, logDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/WALs/jenkins-hbase4.apache.org,39745,1696237347579, archiveDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/oldWALs, maxLogs=10 2023-10-02 09:02:29,457 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37907,DS-5f610856-6526-4177-a21b-b4666e444a8c,DISK] 2023-10-02 09:02:29,457 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37285,DS-2ee10f03-2992-4fc6-9669-aac83168784a,DISK] 2023-10-02 09:02:29,457 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44669,DS-7754ce7e-a694-441b-ac6c-c59419aa904d,DISK] 2023-10-02 09:02:29,467 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-02 09:02:29,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/WALs/jenkins-hbase4.apache.org,39745,1696237347579/jenkins-hbase4.apache.org%2C39745%2C1696237347579.1696237349410 2023-10-02 09:02:29,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37285,DS-2ee10f03-2992-4fc6-9669-aac83168784a,DISK], DatanodeInfoWithStorage[127.0.0.1:37907,DS-5f610856-6526-4177-a21b-b4666e444a8c,DISK], DatanodeInfoWithStorage[127.0.0.1:44669,DS-7754ce7e-a694-441b-ac6c-c59419aa904d,DISK]] 2023-10-02 09:02:29,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-02 09:02:29,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:29,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 09:02:29,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 09:02:29,604 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-02 09:02:29,611 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-02 09:02:29,640 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-02 09:02:29,653 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:29,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-02 09:02:29,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-02 09:02:29,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 09:02:29,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:02:29,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73682073, jitterRate=0.09794844686985016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:02:29,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 09:02:29,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-02 09:02:29,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-02 09:02:29,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-02 09:02:29,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-02 09:02:29,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-02 09:02:29,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 37 msec 2023-10-02 09:02:29,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-02 09:02:29,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-02 09:02:29,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-02 09:02:29,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-02 09:02:29,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-02 09:02:29,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-02 09:02:29,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-02 09:02:29,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-02 09:02:29,830 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:02:29,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-02 09:02:29,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-02 09:02:29,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-02 09:02:29,858 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 09:02:29,858 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 09:02:29,858 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 09:02:29,858 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 09:02:29,858 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:02:29,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39745,1696237347579, sessionid=0x101065f16b50000, setting cluster-up flag (Was=false) 2023-10-02 09:02:29,881 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:02:29,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-02 09:02:29,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39745,1696237347579 2023-10-02 09:02:29,895 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:02:29,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-02 09:02:29,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39745,1696237347579 2023-10-02 09:02:29,905 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp 2023-10-02 09:02:29,946 INFO [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(951): ClusterId : af07caa6-7e7a-441d-aee8-88438dcbd9e7 2023-10-02 09:02:29,947 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(951): ClusterId : af07caa6-7e7a-441d-aee8-88438dcbd9e7 2023-10-02 09:02:29,946 INFO [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(951): ClusterId : af07caa6-7e7a-441d-aee8-88438dcbd9e7 2023-10-02 09:02:29,954 DEBUG [RS:2;jenkins-hbase4:44871] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 09:02:29,954 DEBUG [RS:1;jenkins-hbase4:40077] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 09:02:29,954 DEBUG [RS:0;jenkins-hbase4:39697] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 09:02:29,962 DEBUG [RS:2;jenkins-hbase4:44871] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 09:02:29,962 DEBUG [RS:0;jenkins-hbase4:39697] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 09:02:29,962 DEBUG [RS:1;jenkins-hbase4:40077] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 09:02:29,962 DEBUG [RS:0;jenkins-hbase4:39697] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 09:02:29,962 DEBUG [RS:2;jenkins-hbase4:44871] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 09:02:29,962 DEBUG [RS:1;jenkins-hbase4:40077] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 09:02:29,968 DEBUG [RS:1;jenkins-hbase4:40077] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 09:02:29,968 DEBUG [RS:0;jenkins-hbase4:39697] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 09:02:29,968 DEBUG [RS:2;jenkins-hbase4:44871] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 09:02:29,972 DEBUG [RS:1;jenkins-hbase4:40077] zookeeper.ReadOnlyZKClient(139): Connect 0x62193a57 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:29,973 DEBUG [RS:2;jenkins-hbase4:44871] zookeeper.ReadOnlyZKClient(139): Connect 0x0a15cde8 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:29,973 DEBUG [RS:0;jenkins-hbase4:39697] zookeeper.ReadOnlyZKClient(139): Connect 0x3867f8c3 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:29,987 DEBUG [RS:1;jenkins-hbase4:40077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cdec864, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:29,988 DEBUG [RS:1;jenkins-hbase4:40077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68e15127, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 09:02:30,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-02 09:02:30,032 DEBUG [RS:0;jenkins-hbase4:39697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36a011bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:30,032 DEBUG [RS:0;jenkins-hbase4:39697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@329f93b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 09:02:30,032 DEBUG [RS:2;jenkins-hbase4:44871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d222da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:30,033 DEBUG [RS:2;jenkins-hbase4:44871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@eda698, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 09:02:30,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:30,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-02 09:02:30,054 DEBUG [RS:2;jenkins-hbase4:44871] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44871 2023-10-02 09:02:30,058 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39697 2023-10-02 09:02:30,059 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40077 2023-10-02 09:02:30,059 INFO [RS:2;jenkins-hbase4:44871] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 09:02:30,059 INFO [RS:1;jenkins-hbase4:40077] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 09:02:30,059 INFO [RS:0;jenkins-hbase4:39697] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 09:02:30,060 INFO [RS:1;jenkins-hbase4:40077] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 09:02:30,060 INFO [RS:2;jenkins-hbase4:44871] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 09:02:30,060 INFO [RS:0;jenkins-hbase4:39697] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 09:02:30,061 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 09:02:30,061 DEBUG [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 09:02:30,061 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 09:02:30,062 INFO [RS:0;jenkins-hbase4:39697] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:30,062 INFO [RS:1;jenkins-hbase4:40077] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:30,062 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 09:02:30,062 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 09:02:30,062 INFO [RS:2;jenkins-hbase4:44871] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:30,062 DEBUG [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 09:02:30,065 INFO [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39745,1696237347579 with isa=jenkins-hbase4.apache.org/172.31.14.131:39697, startcode=1696237348836 2023-10-02 09:02:30,065 INFO [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39745,1696237347579 with isa=jenkins-hbase4.apache.org/172.31.14.131:44871, startcode=1696237348922 2023-10-02 09:02:30,065 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39745,1696237347579 with isa=jenkins-hbase4.apache.org/172.31.14.131:40077, startcode=1696237348884 2023-10-02 09:02:30,086 DEBUG [RS:2;jenkins-hbase4:44871] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 09:02:30,086 DEBUG [RS:1;jenkins-hbase4:40077] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 09:02:30,086 DEBUG [RS:0;jenkins-hbase4:39697] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 09:02:30,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-02 09:02:30,152 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34567, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 09:02:30,152 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60555, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 09:02:30,152 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54951, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 09:02:30,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 09:02:30,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 09:02:30,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 09:02:30,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 09:02:30,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-02 09:02:30,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 09:02:30,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,163 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39745] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 09:02:30,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696237380163 2023-10-02 09:02:30,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-02 09:02:30,172 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-02 09:02:30,172 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-02 09:02:30,174 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39745] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 09:02:30,175 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39745] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 09:02:30,194 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 09:02:30,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-02 09:02:30,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-02 09:02:30,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-02 09:02:30,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-02 09:02:30,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-02 09:02:30,204 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 09:02:30,204 DEBUG [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 09:02:30,205 WARN [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 09:02:30,204 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 09:02:30,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,205 WARN [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 09:02:30,205 WARN [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 09:02:30,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-02 09:02:30,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-02 09:02:30,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-02 09:02:30,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-02 09:02:30,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-02 09:02:30,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696237350213,5,FailOnTimeoutGroup] 2023-10-02 09:02:30,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696237350213,5,FailOnTimeoutGroup] 2023-10-02 09:02:30,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-02 09:02:30,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,237 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-02 09:02:30,238 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-02 09:02:30,238 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:02:30,263 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:30,266 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-02 09:02:30,269 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/info 2023-10-02 09:02:30,269 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-02 09:02:30,270 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:30,270 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-02 09:02:30,273 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/rep_barrier 2023-10-02 09:02:30,274 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-02 09:02:30,274 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:30,275 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-02 09:02:30,277 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/table 2023-10-02 09:02:30,277 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-02 09:02:30,278 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:30,280 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740 2023-10-02 09:02:30,280 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740 2023-10-02 09:02:30,284 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-02 09:02:30,286 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-02 09:02:30,290 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:02:30,291 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75168959, jitterRate=0.12010477483272552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-02 09:02:30,291 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-02 09:02:30,291 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-02 09:02:30,291 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-02 09:02:30,291 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-02 09:02:30,291 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-02 09:02:30,291 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-02 09:02:30,293 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-02 09:02:30,293 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-02 09:02:30,300 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-02 09:02:30,300 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-02 09:02:30,306 INFO [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39745,1696237347579 with isa=jenkins-hbase4.apache.org/172.31.14.131:44871, startcode=1696237348922 2023-10-02 09:02:30,306 INFO [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39745,1696237347579 with isa=jenkins-hbase4.apache.org/172.31.14.131:39697, startcode=1696237348836 2023-10-02 09:02:30,307 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39745,1696237347579 with isa=jenkins-hbase4.apache.org/172.31.14.131:40077, startcode=1696237348884 2023-10-02 09:02:30,313 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39745] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:30,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-02 09:02:30,319 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39745] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:30,321 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39745] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:30,321 DEBUG [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:02:30,321 DEBUG [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44077 2023-10-02 09:02:30,321 DEBUG [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 09:02:30,322 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:02:30,322 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44077 2023-10-02 09:02:30,322 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 09:02:30,323 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:02:30,323 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44077 2023-10-02 09:02:30,323 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 09:02:30,330 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 09:02:30,333 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-02 09:02:30,336 DEBUG [RS:1;jenkins-hbase4:40077] zookeeper.ZKUtil(162): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:30,336 WARN [RS:1;jenkins-hbase4:40077] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 09:02:30,336 INFO [RS:1;jenkins-hbase4:40077] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 09:02:30,336 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-02 09:02:30,337 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:30,337 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44871,1696237348922] 2023-10-02 09:02:30,337 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39697,1696237348836] 2023-10-02 09:02:30,337 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40077,1696237348884] 2023-10-02 09:02:30,338 DEBUG [RS:0;jenkins-hbase4:39697] zookeeper.ZKUtil(162): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:30,338 DEBUG [RS:2;jenkins-hbase4:44871] zookeeper.ZKUtil(162): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:30,338 WARN [RS:0;jenkins-hbase4:39697] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 09:02:30,338 WARN [RS:2;jenkins-hbase4:44871] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 09:02:30,339 INFO [RS:0;jenkins-hbase4:39697] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 09:02:30,340 INFO [RS:2;jenkins-hbase4:44871] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 09:02:30,340 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:30,342 DEBUG [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:30,352 DEBUG [RS:2;jenkins-hbase4:44871] zookeeper.ZKUtil(162): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:30,352 DEBUG [RS:0;jenkins-hbase4:39697] zookeeper.ZKUtil(162): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:30,352 DEBUG [RS:1;jenkins-hbase4:40077] zookeeper.ZKUtil(162): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:30,353 DEBUG [RS:2;jenkins-hbase4:44871] zookeeper.ZKUtil(162): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:30,353 DEBUG [RS:0;jenkins-hbase4:39697] zookeeper.ZKUtil(162): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:30,353 DEBUG [RS:1;jenkins-hbase4:40077] zookeeper.ZKUtil(162): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:30,353 DEBUG [RS:2;jenkins-hbase4:44871] zookeeper.ZKUtil(162): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:30,353 DEBUG [RS:0;jenkins-hbase4:39697] zookeeper.ZKUtil(162): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:30,354 DEBUG [RS:1;jenkins-hbase4:40077] zookeeper.ZKUtil(162): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:30,365 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 09:02:30,365 DEBUG [RS:2;jenkins-hbase4:44871] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 09:02:30,365 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 09:02:30,376 INFO [RS:1;jenkins-hbase4:40077] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 09:02:30,376 INFO [RS:2;jenkins-hbase4:44871] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 09:02:30,376 INFO [RS:0;jenkins-hbase4:39697] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 09:02:30,400 INFO [RS:0;jenkins-hbase4:39697] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 09:02:30,400 INFO [RS:1;jenkins-hbase4:40077] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 09:02:30,400 INFO [RS:2;jenkins-hbase4:44871] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 09:02:30,405 INFO [RS:1;jenkins-hbase4:40077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 09:02:30,405 INFO [RS:0;jenkins-hbase4:39697] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 09:02:30,406 INFO [RS:1;jenkins-hbase4:40077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,405 INFO [RS:2;jenkins-hbase4:44871] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 09:02:30,407 INFO [RS:0;jenkins-hbase4:39697] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,407 INFO [RS:2;jenkins-hbase4:44871] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,407 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 09:02:30,408 INFO [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 09:02:30,407 INFO [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 09:02:30,418 INFO [RS:1;jenkins-hbase4:40077] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,418 INFO [RS:2;jenkins-hbase4:44871] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,418 INFO [RS:0;jenkins-hbase4:39697] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,418 DEBUG [RS:1;jenkins-hbase4:40077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:2;jenkins-hbase4:44871] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:1;jenkins-hbase4:40077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:0;jenkins-hbase4:39697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:1;jenkins-hbase4:40077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:2;jenkins-hbase4:44871] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:1;jenkins-hbase4:40077] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:0;jenkins-hbase4:39697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:1;jenkins-hbase4:40077] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:2;jenkins-hbase4:44871] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:1;jenkins-hbase4:40077] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 09:02:30,419 DEBUG [RS:0;jenkins-hbase4:39697] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,420 DEBUG [RS:1;jenkins-hbase4:40077] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,419 DEBUG [RS:2;jenkins-hbase4:44871] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,420 DEBUG [RS:1;jenkins-hbase4:40077] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,420 DEBUG [RS:0;jenkins-hbase4:39697] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,420 DEBUG [RS:1;jenkins-hbase4:40077] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,420 DEBUG [RS:2;jenkins-hbase4:44871] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,420 DEBUG [RS:1;jenkins-hbase4:40077] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,420 DEBUG [RS:0;jenkins-hbase4:39697] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,420 DEBUG [RS:2;jenkins-hbase4:44871] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 09:02:30,420 DEBUG [RS:0;jenkins-hbase4:39697] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 09:02:30,420 DEBUG [RS:2;jenkins-hbase4:44871] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,421 DEBUG [RS:0;jenkins-hbase4:39697] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,421 DEBUG [RS:2;jenkins-hbase4:44871] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,421 DEBUG [RS:0;jenkins-hbase4:39697] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,421 DEBUG [RS:2;jenkins-hbase4:44871] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,421 DEBUG [RS:0;jenkins-hbase4:39697] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,421 DEBUG [RS:2;jenkins-hbase4:44871] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,422 DEBUG [RS:0;jenkins-hbase4:39697] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 09:02:30,422 INFO [RS:1;jenkins-hbase4:40077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,422 INFO [RS:1;jenkins-hbase4:40077] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,422 INFO [RS:1;jenkins-hbase4:40077] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,423 INFO [RS:2;jenkins-hbase4:44871] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,423 INFO [RS:2;jenkins-hbase4:44871] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,424 INFO [RS:2;jenkins-hbase4:44871] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,424 INFO [RS:0;jenkins-hbase4:39697] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,424 INFO [RS:0;jenkins-hbase4:39697] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,424 INFO [RS:0;jenkins-hbase4:39697] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,442 INFO [RS:1;jenkins-hbase4:40077] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 09:02:30,442 INFO [RS:2;jenkins-hbase4:44871] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 09:02:30,442 INFO [RS:0;jenkins-hbase4:39697] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 09:02:30,446 INFO [RS:2;jenkins-hbase4:44871] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44871,1696237348922-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,446 INFO [RS:1;jenkins-hbase4:40077] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40077,1696237348884-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,446 INFO [RS:0;jenkins-hbase4:39697] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39697,1696237348836-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:30,465 INFO [RS:1;jenkins-hbase4:40077] regionserver.Replication(203): jenkins-hbase4.apache.org,40077,1696237348884 started 2023-10-02 09:02:30,465 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40077,1696237348884, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40077, sessionid=0x101065f16b50002 2023-10-02 09:02:30,466 DEBUG [RS:1;jenkins-hbase4:40077] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 09:02:30,466 DEBUG [RS:1;jenkins-hbase4:40077] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:30,466 DEBUG [RS:1;jenkins-hbase4:40077] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40077,1696237348884' 2023-10-02 09:02:30,466 DEBUG [RS:1;jenkins-hbase4:40077] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 09:02:30,467 DEBUG [RS:1;jenkins-hbase4:40077] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 09:02:30,467 DEBUG [RS:1;jenkins-hbase4:40077] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 09:02:30,468 DEBUG [RS:1;jenkins-hbase4:40077] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 09:02:30,468 DEBUG [RS:1;jenkins-hbase4:40077] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:30,468 DEBUG [RS:1;jenkins-hbase4:40077] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40077,1696237348884' 2023-10-02 09:02:30,468 DEBUG [RS:1;jenkins-hbase4:40077] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:30,468 DEBUG [RS:1;jenkins-hbase4:40077] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:30,469 DEBUG [RS:1;jenkins-hbase4:40077] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 09:02:30,469 INFO [RS:1;jenkins-hbase4:40077] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 09:02:30,470 INFO [RS:1;jenkins-hbase4:40077] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 09:02:30,474 INFO [RS:0;jenkins-hbase4:39697] regionserver.Replication(203): jenkins-hbase4.apache.org,39697,1696237348836 started 2023-10-02 09:02:30,475 INFO [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39697,1696237348836, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39697, sessionid=0x101065f16b50001 2023-10-02 09:02:30,475 INFO [RS:2;jenkins-hbase4:44871] regionserver.Replication(203): jenkins-hbase4.apache.org,44871,1696237348922 started 2023-10-02 09:02:30,475 DEBUG [RS:0;jenkins-hbase4:39697] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 09:02:30,475 INFO [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44871,1696237348922, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44871, sessionid=0x101065f16b50003 2023-10-02 09:02:30,475 DEBUG [RS:0;jenkins-hbase4:39697] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:30,476 DEBUG [RS:2;jenkins-hbase4:44871] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 09:02:30,476 DEBUG [RS:0;jenkins-hbase4:39697] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39697,1696237348836' 2023-10-02 09:02:30,476 DEBUG [RS:0;jenkins-hbase4:39697] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 09:02:30,476 DEBUG [RS:2;jenkins-hbase4:44871] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:30,476 DEBUG [RS:2;jenkins-hbase4:44871] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44871,1696237348922' 2023-10-02 09:02:30,477 DEBUG [RS:2;jenkins-hbase4:44871] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 09:02:30,477 DEBUG [RS:2;jenkins-hbase4:44871] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 09:02:30,477 DEBUG [RS:0;jenkins-hbase4:39697] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 09:02:30,478 DEBUG [RS:2;jenkins-hbase4:44871] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 09:02:30,478 DEBUG [RS:0;jenkins-hbase4:39697] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 09:02:30,478 DEBUG [RS:2;jenkins-hbase4:44871] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 09:02:30,478 DEBUG [RS:0;jenkins-hbase4:39697] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 09:02:30,478 DEBUG [RS:0;jenkins-hbase4:39697] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:30,478 DEBUG [RS:2;jenkins-hbase4:44871] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:30,479 DEBUG [RS:2;jenkins-hbase4:44871] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44871,1696237348922' 2023-10-02 09:02:30,479 DEBUG [RS:2;jenkins-hbase4:44871] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:30,479 DEBUG [RS:0;jenkins-hbase4:39697] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39697,1696237348836' 2023-10-02 09:02:30,479 DEBUG [RS:0;jenkins-hbase4:39697] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:30,480 DEBUG [RS:2;jenkins-hbase4:44871] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:30,480 DEBUG [RS:2;jenkins-hbase4:44871] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 09:02:30,487 DEBUG [RS:0;jenkins-hbase4:39697] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:30,480 INFO [RS:2;jenkins-hbase4:44871] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 09:02:30,488 INFO [RS:2;jenkins-hbase4:44871] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 09:02:30,489 DEBUG [RS:0;jenkins-hbase4:39697] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 09:02:30,489 INFO [RS:0;jenkins-hbase4:39697] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 09:02:30,489 INFO [RS:0;jenkins-hbase4:39697] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 09:02:30,490 DEBUG [jenkins-hbase4:39745] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-02 09:02:30,496 DEBUG [jenkins-hbase4:39745] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 09:02:30,503 DEBUG [jenkins-hbase4:39745] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 09:02:30,503 DEBUG [jenkins-hbase4:39745] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 09:02:30,503 DEBUG [jenkins-hbase4:39745] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 09:02:30,503 DEBUG [jenkins-hbase4:39745] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 09:02:30,506 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39697,1696237348836, state=OPENING 2023-10-02 09:02:30,514 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-02 09:02:30,515 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:02:30,516 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-02 09:02:30,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:02:30,581 INFO [RS:1;jenkins-hbase4:40077] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40077%2C1696237348884, suffix=, logDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,40077,1696237348884, archiveDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/oldWALs, maxLogs=32 2023-10-02 09:02:30,591 INFO [RS:2;jenkins-hbase4:44871] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44871%2C1696237348922, suffix=, logDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,44871,1696237348922, archiveDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/oldWALs, maxLogs=32 2023-10-02 09:02:30,592 INFO [RS:0;jenkins-hbase4:39697] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39697%2C1696237348836, suffix=, logDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,39697,1696237348836, archiveDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/oldWALs, maxLogs=32 2023-10-02 09:02:30,609 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37907,DS-5f610856-6526-4177-a21b-b4666e444a8c,DISK] 2023-10-02 09:02:30,609 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37285,DS-2ee10f03-2992-4fc6-9669-aac83168784a,DISK] 2023-10-02 09:02:30,613 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44669,DS-7754ce7e-a694-441b-ac6c-c59419aa904d,DISK] 2023-10-02 09:02:30,615 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37907,DS-5f610856-6526-4177-a21b-b4666e444a8c,DISK] 2023-10-02 09:02:30,615 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44669,DS-7754ce7e-a694-441b-ac6c-c59419aa904d,DISK] 2023-10-02 09:02:30,616 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37285,DS-2ee10f03-2992-4fc6-9669-aac83168784a,DISK] 2023-10-02 09:02:30,620 INFO [RS:1;jenkins-hbase4:40077] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,40077,1696237348884/jenkins-hbase4.apache.org%2C40077%2C1696237348884.1696237350583 2023-10-02 09:02:30,620 DEBUG [RS:1;jenkins-hbase4:40077] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37907,DS-5f610856-6526-4177-a21b-b4666e444a8c,DISK], DatanodeInfoWithStorage[127.0.0.1:37285,DS-2ee10f03-2992-4fc6-9669-aac83168784a,DISK], DatanodeInfoWithStorage[127.0.0.1:44669,DS-7754ce7e-a694-441b-ac6c-c59419aa904d,DISK]] 2023-10-02 09:02:30,629 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37285,DS-2ee10f03-2992-4fc6-9669-aac83168784a,DISK] 2023-10-02 09:02:30,629 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37907,DS-5f610856-6526-4177-a21b-b4666e444a8c,DISK] 2023-10-02 09:02:30,629 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44669,DS-7754ce7e-a694-441b-ac6c-c59419aa904d,DISK] 2023-10-02 09:02:30,630 INFO [RS:0;jenkins-hbase4:39697] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,39697,1696237348836/jenkins-hbase4.apache.org%2C39697%2C1696237348836.1696237350594 2023-10-02 09:02:30,637 DEBUG [RS:0;jenkins-hbase4:39697] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44669,DS-7754ce7e-a694-441b-ac6c-c59419aa904d,DISK], DatanodeInfoWithStorage[127.0.0.1:37907,DS-5f610856-6526-4177-a21b-b4666e444a8c,DISK], DatanodeInfoWithStorage[127.0.0.1:37285,DS-2ee10f03-2992-4fc6-9669-aac83168784a,DISK]] 2023-10-02 09:02:30,644 INFO [RS:2;jenkins-hbase4:44871] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,44871,1696237348922/jenkins-hbase4.apache.org%2C44871%2C1696237348922.1696237350594 2023-10-02 09:02:30,647 DEBUG [RS:2;jenkins-hbase4:44871] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44669,DS-7754ce7e-a694-441b-ac6c-c59419aa904d,DISK], DatanodeInfoWithStorage[127.0.0.1:37285,DS-2ee10f03-2992-4fc6-9669-aac83168784a,DISK], DatanodeInfoWithStorage[127.0.0.1:37907,DS-5f610856-6526-4177-a21b-b4666e444a8c,DISK]] 2023-10-02 09:02:30,706 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:30,708 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 09:02:30,712 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 09:02:30,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-02 09:02:30,728 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 09:02:30,732 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39697%2C1696237348836.meta, suffix=.meta, logDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,39697,1696237348836, archiveDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/oldWALs, maxLogs=32 2023-10-02 09:02:30,751 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44669,DS-7754ce7e-a694-441b-ac6c-c59419aa904d,DISK] 2023-10-02 09:02:30,752 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37285,DS-2ee10f03-2992-4fc6-9669-aac83168784a,DISK] 2023-10-02 09:02:30,757 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37907,DS-5f610856-6526-4177-a21b-b4666e444a8c,DISK] 2023-10-02 09:02:30,763 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/WALs/jenkins-hbase4.apache.org,39697,1696237348836/jenkins-hbase4.apache.org%2C39697%2C1696237348836.meta.1696237350733.meta 2023-10-02 09:02:30,764 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44669,DS-7754ce7e-a694-441b-ac6c-c59419aa904d,DISK], DatanodeInfoWithStorage[127.0.0.1:37285,DS-2ee10f03-2992-4fc6-9669-aac83168784a,DISK], DatanodeInfoWithStorage[127.0.0.1:37907,DS-5f610856-6526-4177-a21b-b4666e444a8c,DISK]] 2023-10-02 09:02:30,764 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-02 09:02:30,765 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-02 09:02:30,767 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:30,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-02 09:02:30,770 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-02 09:02:30,771 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-02 09:02:30,784 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-02 09:02:30,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:30,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-02 09:02:30,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-02 09:02:30,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-02 09:02:30,790 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/info 2023-10-02 09:02:30,790 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/info 2023-10-02 09:02:30,790 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-02 09:02:30,791 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:30,792 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-02 09:02:30,794 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/rep_barrier 2023-10-02 09:02:30,794 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/rep_barrier 2023-10-02 09:02:30,794 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-02 09:02:30,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:30,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-02 09:02:30,797 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/table 2023-10-02 09:02:30,797 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/table 2023-10-02 09:02:30,797 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-02 09:02:30,798 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:30,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740 2023-10-02 09:02:30,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740 2023-10-02 09:02:30,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-02 09:02:30,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-02 09:02:30,812 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63642081, jitterRate=-0.05165909230709076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-02 09:02:30,815 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-02 09:02:30,826 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696237350698 2023-10-02 09:02:30,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-02 09:02:30,847 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-02 09:02:30,848 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39697,1696237348836, state=OPEN 2023-10-02 09:02:30,851 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-02 09:02:30,851 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-02 09:02:30,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-02 09:02:30,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39697,1696237348836 in 331 msec 2023-10-02 09:02:30,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-02 09:02:30,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 547 msec 2023-10-02 09:02:30,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 827 msec 2023-10-02 09:02:30,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696237350874, completionTime=-1 2023-10-02 09:02:30,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-02 09:02:30,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-02 09:02:30,943 DEBUG [hconnection-0xe119ed6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:30,947 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:30,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-02 09:02:30,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696237410980 2023-10-02 09:02:30,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696237470980 2023-10-02 09:02:30,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 106 msec 2023-10-02 09:02:31,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39745,1696237347579-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:31,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39745,1696237347579-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:31,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39745,1696237347579-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:31,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39745, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:31,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-02 09:02:31,017 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-02 09:02:31,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-02 09:02:31,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 09:02:31,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-02 09:02:31,039 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 09:02:31,042 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 09:02:31,065 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4 2023-10-02 09:02:31,069 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4 empty. 2023-10-02 09:02:31,070 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4 2023-10-02 09:02:31,070 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-02 09:02:31,114 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-02 09:02:31,116 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c4d1ef49830f04f4a5795778158a97b4, NAME => 'hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:02:31,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:31,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c4d1ef49830f04f4a5795778158a97b4, disabling compactions & flushes 2023-10-02 09:02:31,134 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:02:31,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:02:31,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. after waiting 0 ms 2023-10-02 09:02:31,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:02:31,134 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:02:31,134 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c4d1ef49830f04f4a5795778158a97b4: 2023-10-02 09:02:31,139 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 09:02:31,158 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696237351142"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237351142"}]},"ts":"1696237351142"} 2023-10-02 09:02:31,195 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-02 09:02:31,197 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 09:02:31,202 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237351197"}]},"ts":"1696237351197"} 2023-10-02 09:02:31,206 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-02 09:02:31,210 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 09:02:31,211 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 09:02:31,211 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 09:02:31,211 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 09:02:31,211 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 09:02:31,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c4d1ef49830f04f4a5795778158a97b4, ASSIGN}] 2023-10-02 09:02:31,218 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c4d1ef49830f04f4a5795778158a97b4, ASSIGN 2023-10-02 09:02:31,219 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c4d1ef49830f04f4a5795778158a97b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40077,1696237348884; forceNewPlan=false, retain=false 2023-10-02 09:02:31,373 INFO [jenkins-hbase4:39745] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 09:02:31,374 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c4d1ef49830f04f4a5795778158a97b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:31,374 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696237351374"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237351374"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237351374"}]},"ts":"1696237351374"} 2023-10-02 09:02:31,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c4d1ef49830f04f4a5795778158a97b4, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:02:31,536 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:31,537 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 09:02:31,540 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 09:02:31,546 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:02:31,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4d1ef49830f04f4a5795778158a97b4, NAME => 'hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4.', STARTKEY => '', ENDKEY => ''} 2023-10-02 09:02:31,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. service=AccessControlService 2023-10-02 09:02:31,548 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:31,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c4d1ef49830f04f4a5795778158a97b4 2023-10-02 09:02:31,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:31,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c4d1ef49830f04f4a5795778158a97b4 2023-10-02 09:02:31,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c4d1ef49830f04f4a5795778158a97b4 2023-10-02 09:02:31,551 INFO [StoreOpener-c4d1ef49830f04f4a5795778158a97b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c4d1ef49830f04f4a5795778158a97b4 2023-10-02 09:02:31,553 DEBUG [StoreOpener-c4d1ef49830f04f4a5795778158a97b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4/info 2023-10-02 09:02:31,553 DEBUG [StoreOpener-c4d1ef49830f04f4a5795778158a97b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4/info 2023-10-02 09:02:31,554 INFO [StoreOpener-c4d1ef49830f04f4a5795778158a97b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4d1ef49830f04f4a5795778158a97b4 columnFamilyName info 2023-10-02 09:02:31,555 INFO [StoreOpener-c4d1ef49830f04f4a5795778158a97b4-1] regionserver.HStore(310): Store=c4d1ef49830f04f4a5795778158a97b4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:31,556 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4 2023-10-02 09:02:31,557 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4 2023-10-02 09:02:31,562 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c4d1ef49830f04f4a5795778158a97b4 2023-10-02 09:02:31,566 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:02:31,566 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c4d1ef49830f04f4a5795778158a97b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69177316, jitterRate=0.030822336673736572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:02:31,567 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c4d1ef49830f04f4a5795778158a97b4: 2023-10-02 09:02:31,568 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4., pid=6, masterSystemTime=1696237351536 2023-10-02 09:02:31,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:02:31,573 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:02:31,575 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c4d1ef49830f04f4a5795778158a97b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:31,575 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696237351574"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237351574"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237351574"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237351574"}]},"ts":"1696237351574"} 2023-10-02 09:02:31,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-02 09:02:31,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c4d1ef49830f04f4a5795778158a97b4, server=jenkins-hbase4.apache.org,40077,1696237348884 in 196 msec 2023-10-02 09:02:31,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-02 09:02:31,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c4d1ef49830f04f4a5795778158a97b4, ASSIGN in 368 msec 2023-10-02 09:02:31,588 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 09:02:31,588 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237351588"}]},"ts":"1696237351588"} 2023-10-02 09:02:31,590 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-02 09:02:31,595 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 09:02:31,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 567 msec 2023-10-02 09:02:31,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-02 09:02:31,641 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-02 09:02:31,641 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:02:31,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:31,665 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:31,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-02 09:02:31,695 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-02 09:02:31,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-10-02 09:02:31,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-02 09:02:31,724 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-02 09:02:31,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-10-02 09:02:31,738 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-02 09:02:31,742 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-02 09:02:31,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.761sec 2023-10-02 09:02:31,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-02 09:02:31,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-02 09:02:31,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-02 09:02:31,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39745,1696237347579-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-02 09:02:31,753 DEBUG [Listener at localhost/38499] zookeeper.ReadOnlyZKClient(139): Connect 0x1bcebd71 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:31,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39745,1696237347579-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-02 09:02:31,758 DEBUG [Listener at localhost/38499] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bf08614, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:31,776 DEBUG [hconnection-0x7cc83f6d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:31,788 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:31,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 09:02:31,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-02 09:02:31,792 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39745,1696237347579 2023-10-02 09:02:31,792 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-02 09:02:31,792 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/test.cache.data in system properties and HBase conf 2023-10-02 09:02:31,792 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop.tmp.dir in system properties and HBase conf 2023-10-02 09:02:31,792 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop.log.dir in system properties and HBase conf 2023-10-02 09:02:31,792 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-02 09:02:31,793 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-02 09:02:31,793 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-02 09:02:31,793 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-02 09:02:31,793 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-02 09:02:31,793 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-02 09:02:31,793 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 09:02:31,793 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 09:02:31,793 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-02 09:02:31,793 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-02 09:02:31,793 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 09:02:31,794 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 09:02:31,794 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-02 09:02:31,794 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/nfs.dump.dir in system properties and HBase conf 2023-10-02 09:02:31,794 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/java.io.tmpdir in system properties and HBase conf 2023-10-02 09:02:31,794 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 09:02:31,794 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-02 09:02:31,794 INFO [Listener at localhost/38499] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-02 09:02:31,795 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 09:02:31,798 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:02:31,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-02 09:02:31,799 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c empty. 2023-10-02 09:02:31,803 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:02:31,803 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-02 09:02:31,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 09:02:31,835 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-02 09:02:31,837 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => d9668d971920f0d14918e01ea0cb573c, NAME => 'hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:02:31,878 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:31,878 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing d9668d971920f0d14918e01ea0cb573c, disabling compactions & flushes 2023-10-02 09:02:31,879 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:02:31,879 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:02:31,879 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. after waiting 0 ms 2023-10-02 09:02:31,879 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:02:31,879 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:02:31,879 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for d9668d971920f0d14918e01ea0cb573c: 2023-10-02 09:02:31,885 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 09:02:31,887 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696237351887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237351887"}]},"ts":"1696237351887"} 2023-10-02 09:02:31,891 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-02 09:02:31,895 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 09:02:31,896 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237351895"}]},"ts":"1696237351895"} 2023-10-02 09:02:31,899 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-02 09:02:31,905 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 09:02:31,906 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 09:02:31,906 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 09:02:31,906 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 09:02:31,906 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 09:02:31,906 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d9668d971920f0d14918e01ea0cb573c, ASSIGN}] 2023-10-02 09:02:31,914 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d9668d971920f0d14918e01ea0cb573c, ASSIGN 2023-10-02 09:02:31,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 09:02:31,917 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=d9668d971920f0d14918e01ea0cb573c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40077,1696237348884; forceNewPlan=false, retain=false 2023-10-02 09:02:32,068 INFO [jenkins-hbase4:39745] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 09:02:32,070 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d9668d971920f0d14918e01ea0cb573c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:32,070 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696237352070"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237352070"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237352070"}]},"ts":"1696237352070"} 2023-10-02 09:02:32,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d9668d971920f0d14918e01ea0cb573c, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:02:32,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 09:02:32,233 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:02:32,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d9668d971920f0d14918e01ea0cb573c, NAME => 'hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c.', STARTKEY => '', ENDKEY => ''} 2023-10-02 09:02:32,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. service=AccessControlService 2023-10-02 09:02:32,234 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:32,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:02:32,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:32,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:02:32,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:02:32,237 INFO [StoreOpener-d9668d971920f0d14918e01ea0cb573c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:02:32,239 DEBUG [StoreOpener-d9668d971920f0d14918e01ea0cb573c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c/l 2023-10-02 09:02:32,239 DEBUG [StoreOpener-d9668d971920f0d14918e01ea0cb573c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c/l 2023-10-02 09:02:32,240 INFO [StoreOpener-d9668d971920f0d14918e01ea0cb573c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9668d971920f0d14918e01ea0cb573c columnFamilyName l 2023-10-02 09:02:32,240 INFO [StoreOpener-d9668d971920f0d14918e01ea0cb573c-1] regionserver.HStore(310): Store=d9668d971920f0d14918e01ea0cb573c/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:32,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:02:32,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:02:32,249 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:02:32,253 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:02:32,254 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d9668d971920f0d14918e01ea0cb573c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68780504, jitterRate=0.024909377098083496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:02:32,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d9668d971920f0d14918e01ea0cb573c: 2023-10-02 09:02:32,256 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c., pid=11, masterSystemTime=1696237352228 2023-10-02 09:02:32,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:02:32,259 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:02:32,260 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d9668d971920f0d14918e01ea0cb573c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:32,260 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696237352260"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237352260"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237352260"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237352260"}]},"ts":"1696237352260"} 2023-10-02 09:02:32,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-02 09:02:32,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d9668d971920f0d14918e01ea0cb573c, server=jenkins-hbase4.apache.org,40077,1696237348884 in 190 msec 2023-10-02 09:02:32,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-02 09:02:32,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=d9668d971920f0d14918e01ea0cb573c, ASSIGN in 365 msec 2023-10-02 09:02:32,277 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 09:02:32,277 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237352277"}]},"ts":"1696237352277"} 2023-10-02 09:02:32,280 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-02 09:02:32,283 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 09:02:32,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 495 msec 2023-10-02 09:02:32,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 09:02:32,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-02 09:02:32,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-02 09:02:33,063 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 09:02:33,452 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 09:02:33,459 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46877_jobhistory____.z6hqm9/webapp 2023-10-02 09:02:33,642 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-02 09:02:33,642 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-02 09:02:33,643 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 09:02:33,646 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 09:02:33,738 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:34,078 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:34,394 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-02 09:02:34,426 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46877 2023-10-02 09:02:34,557 WARN [Listener at jenkins-hbase4.apache.org/37601] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 09:02:34,850 WARN [Listener at jenkins-hbase4.apache.org/37601] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 09:02:34,851 INFO [Listener at jenkins-hbase4.apache.org/37601] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 09:02:34,858 INFO [Listener at jenkins-hbase4.apache.org/37601] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39419_cluster____.whzu4y/webapp 2023-10-02 09:02:34,930 INFO [Listener at jenkins-hbase4.apache.org/37601] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 09:02:34,930 INFO [Listener at jenkins-hbase4.apache.org/37601] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-02 09:02:34,930 INFO [Listener at jenkins-hbase4.apache.org/37601] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 09:02:34,930 INFO [Listener at jenkins-hbase4.apache.org/37601] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 09:02:34,939 INFO [Listener at jenkins-hbase4.apache.org/37601] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:35,144 INFO [Listener at jenkins-hbase4.apache.org/37601] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:35,226 INFO [Listener at jenkins-hbase4.apache.org/37601] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:35,234 INFO [Listener at jenkins-hbase4.apache.org/37601] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39419 2023-10-02 09:02:35,715 WARN [Listener at jenkins-hbase4.apache.org/37847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 09:02:35,740 WARN [Listener at jenkins-hbase4.apache.org/37847] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 09:02:35,740 INFO [Listener at jenkins-hbase4.apache.org/37847] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 09:02:35,748 INFO [Listener at jenkins-hbase4.apache.org/37847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46883_node____.9n5mj5/webapp 2023-10-02 09:02:35,825 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-02 09:02:35,825 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 09:02:35,825 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 09:02:35,826 INFO [Listener at jenkins-hbase4.apache.org/37847] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 09:02:35,849 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:35,869 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:35,932 INFO [Listener at jenkins-hbase4.apache.org/37847] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:35,942 INFO [Listener at jenkins-hbase4.apache.org/37847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46883 2023-10-02 09:02:36,118 WARN [Listener at jenkins-hbase4.apache.org/35395] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 09:02:36,126 WARN [Listener at jenkins-hbase4.apache.org/35395] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 09:02:36,127 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 09:02:36,135 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_32845_node____ax04s8/webapp 2023-10-02 09:02:36,186 INFO [Listener at jenkins-hbase4.apache.org/35395] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-02 09:02:36,186 INFO [Listener at jenkins-hbase4.apache.org/35395] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 09:02:36,186 INFO [Listener at jenkins-hbase4.apache.org/35395] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 09:02:36,186 INFO [Listener at jenkins-hbase4.apache.org/35395] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 09:02:36,194 INFO [Listener at jenkins-hbase4.apache.org/35395] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:36,213 INFO [Listener at jenkins-hbase4.apache.org/35395] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:36,282 INFO [Listener at jenkins-hbase4.apache.org/35395] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 09:02:36,288 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:32845 2023-10-02 09:02:36,313 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-02 09:02:36,315 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:02:36,375 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 09:02:36,395 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=165, AvailableMemoryMB=2370 2023-10-02 09:02:36,395 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-10-02 09:02:36,423 DEBUG [Listener at jenkins-hbase4.apache.org/35395] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-02 09:02:36,435 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-02 09:02:36,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 09:02:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-02 09:02:36,462 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 09:02:36,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-02 09:02:36,465 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 09:02:36,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 09:02:36,471 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:36,471 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:36,472 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0 empty. 2023-10-02 09:02:36,474 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:36,477 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29 empty. 2023-10-02 09:02:36,479 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:36,479 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-02 09:02:36,538 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-02 09:02:36,543 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4d125148bd9934280c504da16d5994f0, NAME => 'testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:02:36,543 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1f77661eff580feb7035f58bd8711a29, NAME => 'testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:02:36,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 09:02:36,590 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-02 09:02:36,593 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:36,593 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:36,597 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 4d125148bd9934280c504da16d5994f0, disabling compactions & flushes 2023-10-02 09:02:36,597 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 1f77661eff580feb7035f58bd8711a29, disabling compactions & flushes 2023-10-02 09:02:36,597 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:36,597 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:36,597 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:36,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:36,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. after waiting 0 ms 2023-10-02 09:02:36,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. after waiting 0 ms 2023-10-02 09:02:36,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:36,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:36,598 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:36,598 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:36,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 4d125148bd9934280c504da16d5994f0: 2023-10-02 09:02:36,598 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 1f77661eff580feb7035f58bd8711a29: 2023-10-02 09:02:36,599 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-02 09:02:36,600 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-02 09:02:36,603 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 09:02:36,605 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696237356604"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237356604"}]},"ts":"1696237356604"} 2023-10-02 09:02:36,605 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696237356604"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237356604"}]},"ts":"1696237356604"} 2023-10-02 09:02:36,655 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 09:02:36,657 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 09:02:36,657 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237356657"}]},"ts":"1696237356657"} 2023-10-02 09:02:36,659 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-02 09:02:36,664 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 09:02:36,669 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 09:02:36,669 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 09:02:36,669 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 09:02:36,669 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 09:02:36,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d125148bd9934280c504da16d5994f0, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1f77661eff580feb7035f58bd8711a29, ASSIGN}] 2023-10-02 09:02:36,672 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1f77661eff580feb7035f58bd8711a29, ASSIGN 2023-10-02 09:02:36,672 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d125148bd9934280c504da16d5994f0, ASSIGN 2023-10-02 09:02:36,674 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1f77661eff580feb7035f58bd8711a29, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40077,1696237348884; forceNewPlan=false, retain=false 2023-10-02 09:02:36,674 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d125148bd9934280c504da16d5994f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39697,1696237348836; forceNewPlan=false, retain=false 2023-10-02 09:02:36,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 09:02:36,824 INFO [jenkins-hbase4:39745] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 09:02:36,826 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1f77661eff580feb7035f58bd8711a29, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:36,826 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4d125148bd9934280c504da16d5994f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:36,827 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696237356826"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237356826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237356826"}]},"ts":"1696237356826"} 2023-10-02 09:02:36,827 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696237356826"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237356826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237356826"}]},"ts":"1696237356826"} 2023-10-02 09:02:36,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 1f77661eff580feb7035f58bd8711a29, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:02:36,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 4d125148bd9934280c504da16d5994f0, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:02:36,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:36,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:36,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1f77661eff580feb7035f58bd8711a29, NAME => 'testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 09:02:36,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d125148bd9934280c504da16d5994f0, NAME => 'testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 09:02:36,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. service=AccessControlService 2023-10-02 09:02:36,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. service=AccessControlService 2023-10-02 09:02:36,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:36,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:36,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:37,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:37,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:37,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:37,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:37,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:37,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:37,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:37,004 INFO [StoreOpener-4d125148bd9934280c504da16d5994f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:37,004 INFO [StoreOpener-1f77661eff580feb7035f58bd8711a29-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:37,007 DEBUG [StoreOpener-1f77661eff580feb7035f58bd8711a29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/cf 2023-10-02 09:02:37,007 DEBUG [StoreOpener-1f77661eff580feb7035f58bd8711a29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/cf 2023-10-02 09:02:37,007 DEBUG [StoreOpener-4d125148bd9934280c504da16d5994f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/cf 2023-10-02 09:02:37,007 DEBUG [StoreOpener-4d125148bd9934280c504da16d5994f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/cf 2023-10-02 09:02:37,011 INFO [StoreOpener-1f77661eff580feb7035f58bd8711a29-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f77661eff580feb7035f58bd8711a29 columnFamilyName cf 2023-10-02 09:02:37,011 INFO [StoreOpener-4d125148bd9934280c504da16d5994f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d125148bd9934280c504da16d5994f0 columnFamilyName cf 2023-10-02 09:02:37,014 INFO [StoreOpener-4d125148bd9934280c504da16d5994f0-1] regionserver.HStore(310): Store=4d125148bd9934280c504da16d5994f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:37,014 INFO [StoreOpener-1f77661eff580feb7035f58bd8711a29-1] regionserver.HStore(310): Store=1f77661eff580feb7035f58bd8711a29/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:37,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:37,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:37,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:37,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:37,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:37,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:37,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:02:37,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d125148bd9934280c504da16d5994f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66672668, jitterRate=-0.006499826908111572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:02:37,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d125148bd9934280c504da16d5994f0: 2023-10-02 09:02:37,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:02:37,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1f77661eff580feb7035f58bd8711a29; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70936949, jitterRate=0.057042911648750305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:02:37,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1f77661eff580feb7035f58bd8711a29: 2023-10-02 09:02:37,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0., pid=16, masterSystemTime=1696237356990 2023-10-02 09:02:37,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29., pid=15, masterSystemTime=1696237356990 2023-10-02 09:02:37,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:37,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:37,041 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4d125148bd9934280c504da16d5994f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:37,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:37,042 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696237357041"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237357041"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237357041"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237357041"}]},"ts":"1696237357041"} 2023-10-02 09:02:37,046 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1f77661eff580feb7035f58bd8711a29, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,046 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696237357046"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237357046"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237357046"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237357046"}]},"ts":"1696237357046"} 2023-10-02 09:02:37,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-02 09:02:37,052 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 4d125148bd9934280c504da16d5994f0, server=jenkins-hbase4.apache.org,39697,1696237348836 in 215 msec 2023-10-02 09:02:37,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-02 09:02:37,055 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d125148bd9934280c504da16d5994f0, ASSIGN in 381 msec 2023-10-02 09:02:37,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 1f77661eff580feb7035f58bd8711a29, server=jenkins-hbase4.apache.org,40077,1696237348884 in 220 msec 2023-10-02 09:02:37,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-02 09:02:37,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1f77661eff580feb7035f58bd8711a29, ASSIGN in 385 msec 2023-10-02 09:02:37,062 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 09:02:37,063 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237357062"}]},"ts":"1696237357062"} 2023-10-02 09:02:37,065 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-02 09:02:37,070 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 09:02:37,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 09:02:37,077 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-02 09:02:37,089 DEBUG [hconnection-0x2999254c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:37,093 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-10-02 09:02:37,105 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 09:02:37,252 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:37,252 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:37,252 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:37,252 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:37,252 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:02:37,276 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:37,276 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:37,276 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:37,276 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 09:02:37,277 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 09:02:37,277 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 09:02:37,277 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 09:02:37,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 830 msec 2023-10-02 09:02:37,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 09:02:37,581 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-02 09:02:37,586 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-02 09:02:37,588 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:37,590 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:02:37,621 DEBUG [hconnection-0x7cc83f6d-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:37,625 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:37,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 09:02:37,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237357643 (current time:1696237357643). 2023-10-02 09:02:37,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:02:37,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x6dec5768 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:37,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d09ce2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:37,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:37,657 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:37,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6dec5768 to 127.0.0.1:60549 2023-10-02 09:02:37,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:02:37,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x57c3ab6f to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:37,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a5fe0de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:37,669 DEBUG [hconnection-0x6006340a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:37,670 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:37,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:37,678 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:37,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57c3ab6f to 127.0.0.1:60549 2023-10-02 09:02:37,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:02:37,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 09:02:37,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:02:37,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 09:02:37,717 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:02:37,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 09:02:37,742 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 09:02:37,743 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696237957743 2023-10-02 09:02:37,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 09:02:37,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-02 09:02:37,746 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 09:02:37,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 09:02:37,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-10-02 09:02:37,750 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 09:02:37,750 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696237957750 2023-10-02 09:02:37,751 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:02:37,751 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:02:37,752 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:02:37,754 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-02 09:02:37,754 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:02:37,754 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-02 09:02:37,755 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-02 09:02:37,755 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-02 09:02:37,755 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:02:37,755 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-02 09:02:37,755 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-02 09:02:37,755 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-02 09:02:37,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,778 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-02 09:02:37,778 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:37,779 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-02 09:02:37,780 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-02 09:02:37,780 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,780 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,786 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:37,786 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:37,786 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,786 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:37,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:37,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:37,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:37,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:37,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:37,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:37,787 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,787 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,788 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,788 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:02:37,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 09:02:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 09:02:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 09:02:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,790 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 09:02:37,790 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 09:02:37,790 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 09:02:37,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,797 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 09:02:37,797 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 09:02:37,797 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:37,797 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 09:02:37,799 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 09:02:37,797 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:37,799 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 09:02:37,800 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 09:02:37,800 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 09:02:37,799 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:37,800 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 09:02:37,801 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 09:02:37,801 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 09:02:37,801 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 09:02:37,801 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 09:02:37,804 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,804 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,805 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,804 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,805 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,805 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:37,805 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:37,805 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,805 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,805 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:37,805 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:37,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:37,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:37,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:37,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-02 09:02:37,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@741c5c21[Count = 1] remaining members to acquire global barrier 2023-10-02 09:02:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:37,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-02 09:02:37,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@741c5c21[Count = 0] remaining members to acquire global barrier 2023-10-02 09:02:37,811 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-02 09:02:37,812 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,814 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,814 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,814 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,815 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,815 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 09:02:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,815 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 09:02:37,815 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,815 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:02:37,816 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:02:37,816 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:02:37,817 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:37,817 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:37,817 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:02:37,817 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 09:02:37,817 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:02:37,817 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 09:02:37,817 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. started... 2023-10-02 09:02:37,817 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:02:37,817 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. started... 2023-10-02 09:02:37,823 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1f77661eff580feb7035f58bd8711a29: 2023-10-02 09:02:37,823 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d125148bd9934280c504da16d5994f0: 2023-10-02 09:02:37,823 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 09:02:37,823 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:37,823 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 09:02:37,825 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,825 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,830 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:02:37,830 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:02:37,834 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:02:37,834 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:02:37,852 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:02:37,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 09:02:37,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:02:37,867 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:02:37,868 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. completed. 2023-10-02 09:02:37,868 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:37,869 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. completed. 2023-10-02 09:02:37,869 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:37,869 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:02:37,869 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:02:37,869 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:02:37,869 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:02:37,869 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,869 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,869 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 09:02:37,869 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:02:37,869 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 09:02:37,869 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:02:37,871 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 09:02:37,871 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,871 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 09:02:37,871 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,871 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:37,871 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:37,872 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 09:02:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,873 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 09:02:37,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:37,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:37,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:37,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:37,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:37,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40077,1696237348884': 2023-10-02 09:02:37,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-02 09:02:37,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:37,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:37,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:37,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:37,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:37,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39697,1696237348836': 2023-10-02 09:02:37,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-02 09:02:37,884 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-02 09:02:37,884 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:02:37,884 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:02:37,884 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,884 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:02:37,887 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,888 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,887 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:37,888 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:37,888 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,888 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,888 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:37,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:37,888 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:37,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:37,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:37,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:37,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:37,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,889 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:37,890 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:37,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,892 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,893 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,893 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,907 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,907 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:37,908 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:37,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:37,908 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,907 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:37,908 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:37,908 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:37,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,908 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:37,909 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-02 09:02:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:37,908 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:37,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:37,908 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:37,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:37,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:02:37,908 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:37,910 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,910 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:37,910 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:37,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:37,910 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:37,910 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:37,910 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,910 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 09:02:37,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-02 09:02:37,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,986 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:37,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696237357743Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696237357928 (+185 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696237357928Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696237357928Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696237357943 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696237357970 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696237357985 (+15 ms) 2023-10-02 09:02:37,988 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 09:02:37,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 243 msec 2023-10-02 09:02:38,068 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:02:38,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 09:02:38,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:02:38,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39697] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:02:38,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40077] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:02:38,097 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-02 09:02:38,097 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:38,097 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:02:38,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 09:02:38,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237358115 (current time:1696237358115). 2023-10-02 09:02:38,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:02:38,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x417af3e4 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:38,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@384b5016, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:38,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:38,129 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:38,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x417af3e4 to 127.0.0.1:60549 2023-10-02 09:02:38,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:02:38,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x0e4bd978 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:38,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1838fe86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:38,140 DEBUG [hconnection-0x7a11d677-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:38,143 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:38,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:38,150 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:38,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e4bd978 to 127.0.0.1:60549 2023-10-02 09:02:38,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:02:38,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 09:02:38,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:02:38,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 09:02:38,156 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:02:38,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 09:02:38,159 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 09:02:38,160 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696237958160 2023-10-02 09:02:38,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 09:02:38,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-02 09:02:38,162 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:02:38,162 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:02:38,163 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 09:02:38,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 09:02:38,165 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-02 09:02:38,166 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 09:02:38,167 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696237958167 2023-10-02 09:02:38,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-02 09:02:38,193 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-02 09:02:38,193 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:38,195 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-02 09:02:38,195 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-02 09:02:38,195 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,195 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,198 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:38,198 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:38,198 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:38,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:38,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:38,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:38,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:38,198 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:38,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:38,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,199 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,199 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,200 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,200 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 09:02:38,201 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 09:02:38,200 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 09:02:38,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 09:02:38,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 09:02:38,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 09:02:38,201 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 09:02:38,201 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 09:02:38,201 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:38,201 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 09:02:38,203 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 09:02:38,203 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 09:02:38,203 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:38,201 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:38,204 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 09:02:38,205 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 09:02:38,205 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 09:02:38,205 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 09:02:38,205 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 09:02:38,203 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 09:02:38,205 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 09:02:38,207 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,207 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,207 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:38,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:38,208 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,208 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:38,208 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,208 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:38,208 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:38,208 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:38,209 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,209 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:38,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 09:02:38,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:38,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-02 09:02:38,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff4143e[Count = 1] remaining members to acquire global barrier 2023-10-02 09:02:38,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:38,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:38,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 09:02:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:38,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-02 09:02:38,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff4143e[Count = 0] remaining members to acquire global barrier 2023-10-02 09:02:38,213 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-02 09:02:38,213 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,219 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,219 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,219 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,219 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,219 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 09:02:38,219 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 09:02:38,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,219 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 09:02:38,220 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 09:02:38,220 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,220 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:02:38,220 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:02:38,220 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:02:38,220 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:02:38,220 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:38,220 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:02:38,220 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:02:38,220 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:38,220 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. started... 2023-10-02 09:02:38,220 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. started... 2023-10-02 09:02:38,220 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4d125148bd9934280c504da16d5994f0 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-02 09:02:38,220 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1f77661eff580feb7035f58bd8711a29 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-02 09:02:38,223 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 09:02:38,223 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:38,223 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 09:02:38,262 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:02:38,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 09:02:38,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:02:38,264 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:02:38,368 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310028d26f9db9ad04d9d8d9995e5d5481f55 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310028d26f9db9ad04d9d8d9995e5d5481f55 2023-10-02 09:02:38,368 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310022cb7620e178540b492e8827a4dfde1b7 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310022cb7620e178540b492e8827a4dfde1b7 2023-10-02 09:02:38,403 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/.tmp/cf/b788eee981514792911810c2bdc6cd48 2023-10-02 09:02:38,405 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/.tmp/cf/f083ba3c2e1b42b79e81bc14b7f6b0d6 2023-10-02 09:02:38,417 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/.tmp/cf/f083ba3c2e1b42b79e81bc14b7f6b0d6 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/cf/f083ba3c2e1b42b79e81bc14b7f6b0d6 2023-10-02 09:02:38,417 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/.tmp/cf/b788eee981514792911810c2bdc6cd48 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/cf/b788eee981514792911810c2bdc6cd48 2023-10-02 09:02:38,426 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/cf/b788eee981514792911810c2bdc6cd48, entries=5, sequenceid=6, filesize=5.7 K 2023-10-02 09:02:38,426 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/cf/f083ba3c2e1b42b79e81bc14b7f6b0d6, entries=45, sequenceid=6, filesize=12.5 K 2023-10-02 09:02:38,431 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 4d125148bd9934280c504da16d5994f0 in 211ms, sequenceid=6, compaction requested=false 2023-10-02 09:02:38,431 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 1f77661eff580feb7035f58bd8711a29 in 211ms, sequenceid=6, compaction requested=false 2023-10-02 09:02:38,431 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-02 09:02:38,431 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-02 09:02:38,434 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d125148bd9934280c504da16d5994f0: 2023-10-02 09:02:38,434 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1f77661eff580feb7035f58bd8711a29: 2023-10-02 09:02:38,434 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 09:02:38,434 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 09:02:38,435 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:02:38,435 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:02:38,435 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/cf/b788eee981514792911810c2bdc6cd48] hfiles 2023-10-02 09:02:38,435 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/cf/f083ba3c2e1b42b79e81bc14b7f6b0d6] hfiles 2023-10-02 09:02:38,435 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/cf/b788eee981514792911810c2bdc6cd48 for snapshot=snaptb0-testExportWithTargetName 2023-10-02 09:02:38,435 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/cf/f083ba3c2e1b42b79e81bc14b7f6b0d6 for snapshot=snaptb0-testExportWithTargetName 2023-10-02 09:02:38,464 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. completed. 2023-10-02 09:02:38,464 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. completed. 2023-10-02 09:02:38,464 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:38,464 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:02:38,464 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:02:38,465 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:02:38,464 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:38,465 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,465 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:02:38,465 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:02:38,465 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,465 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 09:02:38,465 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 09:02:38,465 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:02:38,465 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:02:38,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 09:02:38,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:02:38,466 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 09:02:38,467 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,467 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 09:02:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:38,467 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:38,467 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 09:02:38,469 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 09:02:38,469 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,469 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:38,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:38,469 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 09:02:38,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:38,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 09:02:38,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:38,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 09:02:38,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39697,1696237348836': 2023-10-02 09:02:38,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-02 09:02:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 09:02:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:38,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 09:02:38,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40077,1696237348884': 2023-10-02 09:02:38,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-02 09:02:38,482 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-02 09:02:38,482 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:02:38,482 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:02:38,482 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-02 09:02:38,482 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:02:38,485 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,485 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,485 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:38,485 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:38,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,485 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,485 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,486 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:38,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:38,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:38,486 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:38,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:38,487 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 09:02:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,488 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 09:02:38,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:38,490 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 09:02:38,491 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,491 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,505 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:38,505 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:38,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:38,505 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:38,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:38,505 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,506 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:38,505 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:38,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-02 09:02:38,506 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:38,506 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:38,507 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:38,507 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,507 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,507 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:38,507 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,507 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:38,507 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:38,507 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,507 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,507 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-02 09:02:38,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:38,507 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:38,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 09:02:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:38,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:38,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:38,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:02:38,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:38,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310022cb7620e178540b492e8827a4dfde1b7, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310028d26f9db9ad04d9d8d9995e5d5481f55] mob files 2023-10-02 09:02:38,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310022cb7620e178540b492e8827a4dfde1b7 2023-10-02 09:02:38,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310028d26f9db9ad04d9d8d9995e5d5481f55 2023-10-02 09:02:38,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-02 09:02:38,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-02 09:02:38,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,574 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 09:02:38,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696237358160Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696237358528 (+368 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696237358528Loading Region manifests for snaptb0-testExportWithTargetName at 1696237358528Writing data manifest for snaptb0-testExportWithTargetName at 1696237358534 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696237358560 (+26 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696237358574 (+14 ms) 2023-10-02 09:02:38,577 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 09:02:38,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 417 msec 2023-10-02 09:02:38,767 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:02:38,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 09:02:38,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:02:38,770 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237358770 2023-10-02 09:02:38,771 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44077, tgtDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237358770, rawTgtDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237358770, srcFsUri=hdfs://localhost:44077, srcDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:02:38,813 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:02:38,813 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1380965195_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237358770, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237358770/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-02 09:02:38,813 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247, snapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-02 09:02:38,833 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237358770/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-02 09:02:39,308 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:39,309 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:39,309 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:39,309 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:40,232 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-1911183272816280852.jar 2023-10-02 09:02:40,233 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:40,233 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:40,302 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-6572702821345334146.jar 2023-10-02 09:02:40,302 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:40,303 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:40,303 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:40,304 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:40,304 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:40,304 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:40,305 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 09:02:40,305 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 09:02:40,306 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 09:02:40,307 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 09:02:40,307 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 09:02:40,308 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 09:02:40,308 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 09:02:40,309 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 09:02:40,309 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 09:02:40,310 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 09:02:40,314 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:02:40,314 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:02:40,315 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:02:40,315 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:02:40,316 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:02:40,316 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:02:40,317 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:02:41,150 WARN [Listener at jenkins-hbase4.apache.org/35395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 09:02:41,156 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-02 09:02:41,168 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-02 09:02:41,631 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:02:41,633 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:02:42,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0001_000001 (auth:SIMPLE) 2023-10-02 09:02:42,505 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 09:02:46,774 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0001_000001 (auth:SIMPLE) 2023-10-02 09:02:49,080 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0001_000001 (auth:SIMPLE) 2023-10-02 09:02:51,865 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0001_000001 (auth:SIMPLE) 2023-10-02 09:02:53,147 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 09:02:53,151 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 09:02:53,162 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-02 09:02:53,162 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 09:02:53,163 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 09:02:53,163 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-02 09:02:53,164 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-02 09:02:53,164 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-02 09:02:53,164 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237358770/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237358770/.hbase-snapshot/testExportWithTargetName 2023-10-02 09:02:53,165 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237358770/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-02 09:02:53,165 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237358770/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-02 09:02:53,176 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-02 09:02:53,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-02 09:02:53,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-02 09:02:53,195 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237373194"}]},"ts":"1696237373194"} 2023-10-02 09:02:53,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 09:02:53,197 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-02 09:02:53,199 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-02 09:02:53,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d125148bd9934280c504da16d5994f0, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1f77661eff580feb7035f58bd8711a29, UNASSIGN}] 2023-10-02 09:02:53,203 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d125148bd9934280c504da16d5994f0, UNASSIGN 2023-10-02 09:02:53,203 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1f77661eff580feb7035f58bd8711a29, UNASSIGN 2023-10-02 09:02:53,205 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4d125148bd9934280c504da16d5994f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:53,205 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1f77661eff580feb7035f58bd8711a29, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:53,205 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696237373205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237373205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237373205"}]},"ts":"1696237373205"} 2023-10-02 09:02:53,205 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696237373205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237373205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237373205"}]},"ts":"1696237373205"} 2023-10-02 09:02:53,207 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 4d125148bd9934280c504da16d5994f0, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:02:53,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 1f77661eff580feb7035f58bd8711a29, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:02:53,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 09:02:53,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:53,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:53,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d125148bd9934280c504da16d5994f0, disabling compactions & flushes 2023-10-02 09:02:53,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1f77661eff580feb7035f58bd8711a29, disabling compactions & flushes 2023-10-02 09:02:53,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:53,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:53,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:53,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:53,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. after waiting 0 ms 2023-10-02 09:02:53,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. after waiting 0 ms 2023-10-02 09:02:53,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:53,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:53,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:02:53,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:02:53,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:02:53,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:02:53,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0. 2023-10-02 09:02:53,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29. 2023-10-02 09:02:53,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1f77661eff580feb7035f58bd8711a29: 2023-10-02 09:02:53,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d125148bd9934280c504da16d5994f0: 2023-10-02 09:02:53,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:53,397 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4d125148bd9934280c504da16d5994f0, regionState=CLOSED 2023-10-02 09:02:53,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:53,397 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696237373397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237373397"}]},"ts":"1696237373397"} 2023-10-02 09:02:53,398 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1f77661eff580feb7035f58bd8711a29, regionState=CLOSED 2023-10-02 09:02:53,398 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696237373398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237373398"}]},"ts":"1696237373398"} 2023-10-02 09:02:53,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-02 09:02:53,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 4d125148bd9934280c504da16d5994f0, server=jenkins-hbase4.apache.org,39697,1696237348836 in 192 msec 2023-10-02 09:02:53,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-02 09:02:53,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 1f77661eff580feb7035f58bd8711a29, server=jenkins-hbase4.apache.org,40077,1696237348884 in 192 msec 2023-10-02 09:02:53,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d125148bd9934280c504da16d5994f0, UNASSIGN in 201 msec 2023-10-02 09:02:53,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-02 09:02:53,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1f77661eff580feb7035f58bd8711a29, UNASSIGN in 202 msec 2023-10-02 09:02:53,407 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237373406"}]},"ts":"1696237373406"} 2023-10-02 09:02:53,408 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-02 09:02:53,410 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-02 09:02:53,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 227 msec 2023-10-02 09:02:53,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 09:02:53,499 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-02 09:02:53,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-02 09:02:53,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 09:02:53,514 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 09:02:53,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-02 09:02:53,517 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 09:02:53,520 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-02 09:02:53,523 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:53,523 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:53,526 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/recovered.edits] 2023-10-02 09:02:53,526 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/recovered.edits] 2023-10-02 09:02:53,529 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:53,529 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:53,529 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:53,529 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:53,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-02 09:02:53,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-02 09:02:53,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-02 09:02:53,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-02 09:02:53,531 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:53,531 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:53,531 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:53,531 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:53,531 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:53,531 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:53,531 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 09:02:53,532 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:53,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-02 09:02:53,535 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/cf/f083ba3c2e1b42b79e81bc14b7f6b0d6 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/cf/f083ba3c2e1b42b79e81bc14b7f6b0d6 2023-10-02 09:02:53,535 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/cf/b788eee981514792911810c2bdc6cd48 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/cf/b788eee981514792911810c2bdc6cd48 2023-10-02 09:02:53,540 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29/recovered.edits/9.seqid 2023-10-02 09:02:53,540 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0/recovered.edits/9.seqid 2023-10-02 09:02:53,540 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/1f77661eff580feb7035f58bd8711a29 2023-10-02 09:02:53,541 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportWithTargetName/4d125148bd9934280c504da16d5994f0 2023-10-02 09:02:53,541 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-02 09:02:53,541 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-02 09:02:53,542 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-02 09:02:53,547 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310022cb7620e178540b492e8827a4dfde1b7 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310022cb7620e178540b492e8827a4dfde1b7 2023-10-02 09:02:53,549 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310028d26f9db9ad04d9d8d9995e5d5481f55 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310028d26f9db9ad04d9d8d9995e5d5481f55 2023-10-02 09:02:53,549 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-02 09:02:53,552 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 09:02:53,574 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-02 09:02:53,577 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-02 09:02:53,579 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 09:02:53,579 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-02 09:02:53,579 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237373579"}]},"ts":"9223372036854775807"} 2023-10-02 09:02:53,579 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237373579"}]},"ts":"9223372036854775807"} 2023-10-02 09:02:53,582 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 09:02:53,582 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4d125148bd9934280c504da16d5994f0, NAME => 'testtb-testExportWithTargetName,,1696237356445.4d125148bd9934280c504da16d5994f0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1f77661eff580feb7035f58bd8711a29, NAME => 'testtb-testExportWithTargetName,1,1696237356445.1f77661eff580feb7035f58bd8711a29.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 09:02:53,582 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-02 09:02:53,582 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696237373582"}]},"ts":"9223372036854775807"} 2023-10-02 09:02:53,584 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-02 09:02:53,586 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 09:02:53,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 82 msec 2023-10-02 09:02:53,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-02 09:02:53,638 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-02 09:02:53,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-02 09:02:53,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-02 09:02:53,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-02 09:02:53,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-02 09:02:53,695 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 705) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:43381 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:36922 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:37847 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1468752916_1 at /127.0.0.1:36898 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:58096 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:40435 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1468752916_1 at /127.0.0.1:39012 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:39028 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=287 (was 250) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=1588 (was 2370) 2023-10-02 09:02:53,695 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-02 09:02:53,715 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=168, AvailableMemoryMB=1587 2023-10-02 09:02:53,716 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-02 09:02:53,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 09:02:53,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-02 09:02:53,724 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 09:02:53,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-02 09:02:53,726 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 09:02:53,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 09:02:53,730 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:02:53,730 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198 2023-10-02 09:02:53,730 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d empty. 2023-10-02 09:02:53,730 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198 empty. 2023-10-02 09:02:53,731 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198 2023-10-02 09:02:53,731 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:02:53,731 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-02 09:02:53,755 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-02 09:02:53,757 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b656cbb5585fcbc19cacaf4c68053d7d, NAME => 'testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:02:53,757 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 73171b469fa202184d2c9bc76c95f198, NAME => 'testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:02:53,775 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:53,778 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b656cbb5585fcbc19cacaf4c68053d7d, disabling compactions & flushes 2023-10-02 09:02:53,779 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:53,779 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:53,780 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. after waiting 0 ms 2023-10-02 09:02:53,780 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:53,780 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:53,780 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b656cbb5585fcbc19cacaf4c68053d7d: 2023-10-02 09:02:53,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:53,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 73171b469fa202184d2c9bc76c95f198, disabling compactions & flushes 2023-10-02 09:02:53,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:53,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:53,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. after waiting 0 ms 2023-10-02 09:02:53,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:53,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:53,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 73171b469fa202184d2c9bc76c95f198: 2023-10-02 09:02:53,787 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 09:02:53,788 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696237373788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237373788"}]},"ts":"1696237373788"} 2023-10-02 09:02:53,789 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696237373788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237373788"}]},"ts":"1696237373788"} 2023-10-02 09:02:53,791 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 09:02:53,793 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 09:02:53,793 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237373793"}]},"ts":"1696237373793"} 2023-10-02 09:02:53,795 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-02 09:02:53,799 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 09:02:53,801 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 09:02:53,801 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 09:02:53,801 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 09:02:53,801 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 09:02:53,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b656cbb5585fcbc19cacaf4c68053d7d, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73171b469fa202184d2c9bc76c95f198, ASSIGN}] 2023-10-02 09:02:53,804 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b656cbb5585fcbc19cacaf4c68053d7d, ASSIGN 2023-10-02 09:02:53,804 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73171b469fa202184d2c9bc76c95f198, ASSIGN 2023-10-02 09:02:53,806 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b656cbb5585fcbc19cacaf4c68053d7d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40077,1696237348884; forceNewPlan=false, retain=false 2023-10-02 09:02:53,806 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73171b469fa202184d2c9bc76c95f198, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44871,1696237348922; forceNewPlan=false, retain=false 2023-10-02 09:02:53,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 09:02:53,956 INFO [jenkins-hbase4:39745] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 09:02:53,959 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b656cbb5585fcbc19cacaf4c68053d7d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:53,959 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=73171b469fa202184d2c9bc76c95f198, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:53,960 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696237373959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237373959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237373959"}]},"ts":"1696237373959"} 2023-10-02 09:02:53,960 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696237373959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237373959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237373959"}]},"ts":"1696237373959"} 2023-10-02 09:02:53,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure b656cbb5585fcbc19cacaf4c68053d7d, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:02:53,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 73171b469fa202184d2c9bc76c95f198, server=jenkins-hbase4.apache.org,44871,1696237348922}] 2023-10-02 09:02:54,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 09:02:54,118 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,118 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 09:02:54,122 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 09:02:54,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:54,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b656cbb5585fcbc19cacaf4c68053d7d, NAME => 'testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 09:02:54,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. service=AccessControlService 2023-10-02 09:02:54,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:54,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:02:54,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:54,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:02:54,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:02:54,129 INFO [StoreOpener-b656cbb5585fcbc19cacaf4c68053d7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:02:54,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:54,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 73171b469fa202184d2c9bc76c95f198, NAME => 'testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 09:02:54,131 DEBUG [StoreOpener-b656cbb5585fcbc19cacaf4c68053d7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/cf 2023-10-02 09:02:54,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. service=AccessControlService 2023-10-02 09:02:54,131 DEBUG [StoreOpener-b656cbb5585fcbc19cacaf4c68053d7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/cf 2023-10-02 09:02:54,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:02:54,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 73171b469fa202184d2c9bc76c95f198 2023-10-02 09:02:54,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:02:54,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 73171b469fa202184d2c9bc76c95f198 2023-10-02 09:02:54,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 73171b469fa202184d2c9bc76c95f198 2023-10-02 09:02:54,132 INFO [StoreOpener-b656cbb5585fcbc19cacaf4c68053d7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b656cbb5585fcbc19cacaf4c68053d7d columnFamilyName cf 2023-10-02 09:02:54,133 INFO [StoreOpener-73171b469fa202184d2c9bc76c95f198-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 73171b469fa202184d2c9bc76c95f198 2023-10-02 09:02:54,134 INFO [StoreOpener-b656cbb5585fcbc19cacaf4c68053d7d-1] regionserver.HStore(310): Store=b656cbb5585fcbc19cacaf4c68053d7d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:54,136 DEBUG [StoreOpener-73171b469fa202184d2c9bc76c95f198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/cf 2023-10-02 09:02:54,136 DEBUG [StoreOpener-73171b469fa202184d2c9bc76c95f198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/cf 2023-10-02 09:02:54,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:02:54,136 INFO [StoreOpener-73171b469fa202184d2c9bc76c95f198-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73171b469fa202184d2c9bc76c95f198 columnFamilyName cf 2023-10-02 09:02:54,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:02:54,137 INFO [StoreOpener-73171b469fa202184d2c9bc76c95f198-1] regionserver.HStore(310): Store=73171b469fa202184d2c9bc76c95f198/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:02:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198 2023-10-02 09:02:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198 2023-10-02 09:02:54,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:02:54,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 73171b469fa202184d2c9bc76c95f198 2023-10-02 09:02:54,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:02:54,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:02:54,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b656cbb5585fcbc19cacaf4c68053d7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66769608, jitterRate=-0.0050553083419799805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:02:54,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 73171b469fa202184d2c9bc76c95f198; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60691519, jitterRate=-0.09562589228153229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:02:54,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b656cbb5585fcbc19cacaf4c68053d7d: 2023-10-02 09:02:54,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 73171b469fa202184d2c9bc76c95f198: 2023-10-02 09:02:54,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d., pid=30, masterSystemTime=1696237374115 2023-10-02 09:02:54,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198., pid=31, masterSystemTime=1696237374118 2023-10-02 09:02:54,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:54,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:54,162 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b656cbb5585fcbc19cacaf4c68053d7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:54,162 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696237374162"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237374162"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237374162"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237374162"}]},"ts":"1696237374162"} 2023-10-02 09:02:54,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:54,164 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=73171b469fa202184d2c9bc76c95f198, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,165 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696237374164"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237374164"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237374164"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237374164"}]},"ts":"1696237374164"} 2023-10-02 09:02:54,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-02 09:02:54,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure b656cbb5585fcbc19cacaf4c68053d7d, server=jenkins-hbase4.apache.org,40077,1696237348884 in 205 msec 2023-10-02 09:02:54,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-02 09:02:54,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 73171b469fa202184d2c9bc76c95f198, server=jenkins-hbase4.apache.org,44871,1696237348922 in 205 msec 2023-10-02 09:02:54,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b656cbb5585fcbc19cacaf4c68053d7d, ASSIGN in 369 msec 2023-10-02 09:02:54,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-02 09:02:54,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73171b469fa202184d2c9bc76c95f198, ASSIGN in 371 msec 2023-10-02 09:02:54,175 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 09:02:54,176 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237374175"}]},"ts":"1696237374175"} 2023-10-02 09:02:54,177 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-02 09:02:54,180 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 09:02:54,180 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-02 09:02:54,182 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 09:02:54,184 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:54,184 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:54,184 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:54,184 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:02:54,186 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 09:02:54,186 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 09:02:54,186 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 09:02:54,186 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 09:02:54,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 465 msec 2023-10-02 09:02:54,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 09:02:54,333 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-02 09:02:54,337 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-02 09:02:54,337 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:54,340 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:02:54,351 DEBUG [hconnection-0x7cc83f6d-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:54,358 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:54,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:02:54,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237374362 (current time:1696237374362). 2023-10-02 09:02:54,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:02:54,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x3a76255b to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:54,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77136127, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:54,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:54,376 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:54,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a76255b to 127.0.0.1:60549 2023-10-02 09:02:54,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:02:54,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x58895014 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:54,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53deeaa3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:54,388 DEBUG [hconnection-0x3f28b3a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:54,392 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:54,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:54,398 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:54,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58895014 to 127.0.0.1:60549 2023-10-02 09:02:54,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:02:54,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 09:02:54,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:02:54,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:02:54,405 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:02:54,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:02:54,409 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:02:54,410 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696237974410 2023-10-02 09:02:54,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-02 09:02:54,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:02:54,412 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:02:54,412 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:02:54,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 09:02:54,414 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:02:54,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-10-02 09:02:54,417 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 09:02:54,418 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696237974418 2023-10-02 09:02:54,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,431 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-02 09:02:54,431 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:54,433 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-02 09:02:54,433 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-02 09:02:54,434 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,434 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,436 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,436 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,436 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,436 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,437 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,437 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 09:02:54,438 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,438 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:02:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 09:02:54,438 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 09:02:54,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,439 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 09:02:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 09:02:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,439 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 09:02:54,441 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,441 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 09:02:54,441 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,441 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,441 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 09:02:54,441 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 09:02:54,441 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:54,441 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:54,443 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 09:02:54,444 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 09:02:54,444 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 09:02:54,444 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 09:02:54,441 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:54,444 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 09:02:54,444 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 09:02:54,445 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 09:02:54,445 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 09:02:54,445 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 09:02:54,447 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,456 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,456 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,456 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:54,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:54,456 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,456 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:54,456 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,456 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:54,456 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,457 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:54,457 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:54,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-02 09:02:54,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9807799[Count = 1] remaining members to acquire global barrier 2023-10-02 09:02:54,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:54,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:54,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-02 09:02:54,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9807799[Count = 0] remaining members to acquire global barrier 2023-10-02 09:02:54,462 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 09:02:54,462 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,463 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,463 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,463 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:02:54,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 09:02:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:02:54,464 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:02:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:02:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:02:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:02:54,464 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:02:54,464 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. started... 2023-10-02 09:02:54,464 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:02:54,464 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:54,465 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. started... 2023-10-02 09:02:54,465 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b656cbb5585fcbc19cacaf4c68053d7d: 2023-10-02 09:02:54,466 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73171b469fa202184d2c9bc76c95f198: 2023-10-02 09:02:54,466 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,466 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,466 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:02:54,466 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,466 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:02:54,467 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:02:54,467 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:02:54,467 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:02:54,468 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 09:02:54,468 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:54,468 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 09:02:54,501 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. completed. 2023-10-02 09:02:54,501 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:54,501 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:02:54,501 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:02:54,501 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,501 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 09:02:54,502 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:02:54,503 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. completed. 2023-10-02 09:02:54,503 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:02:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:02:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 09:02:54,503 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:02:54,504 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 09:02:54,504 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,504 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:54,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:54,504 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 09:02:54,511 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,511 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 09:02:54,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:54,511 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:54,511 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 09:02:54,512 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:02:54,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:54,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 09:02:54,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:02:54,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,514 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:02:54,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:54,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40077,1696237348884': 2023-10-02 09:02:54,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 09:02:54,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:54,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:54,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44871,1696237348922': 2023-10-02 09:02:54,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 09:02:54,521 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-02 09:02:54,521 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:02:54,521 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:02:54,521 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,521 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:02:54,523 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,523 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,523 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,523 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:54,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:54,523 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,523 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,523 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:54,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,524 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,525 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:54,525 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:54,528 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,529 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,529 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,533 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,533 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,533 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,533 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,533 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:54,533 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,533 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,533 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-02 09:02:54,533 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,557 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:02:54,558 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,558 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,558 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,558 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,558 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,558 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,558 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,558 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 09:02:54,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-02 09:02:54,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,612 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 09:02:54,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696237374410Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696237374573 (+163 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696237374573Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696237374574 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696237374586 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696237374602 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696237374611 (+9 ms) 2023-10-02 09:02:54,614 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 09:02:54,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 202 msec 2023-10-02 09:02:54,633 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-02 09:02:54,714 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:02:54,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 09:02:54,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:02:54,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40077] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:02:54,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44871] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:02:54,726 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-02 09:02:54,726 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:54,726 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:02:54,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:02:54,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237374741 (current time:1696237374741). 2023-10-02 09:02:54,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:02:54,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x2c9e3290 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:54,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c3e342f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:54,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:54,755 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:54,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c9e3290 to 127.0.0.1:60549 2023-10-02 09:02:54,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:02:54,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x6b25f720 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:02:54,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ba087db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:02:54,766 DEBUG [hconnection-0x77d98ded-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:54,767 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:54,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:02:54,775 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:02:54,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b25f720 to 127.0.0.1:60549 2023-10-02 09:02:54,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:02:54,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 09:02:54,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:02:54,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:02:54,780 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:02:54,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:02:54,783 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:02:54,784 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696237974784 2023-10-02 09:02:54,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:02:54,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-02 09:02:54,786 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:02:54,786 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:02:54,787 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:02:54,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 09:02:54,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-02 09:02:54,790 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 09:02:54,791 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696237974791 2023-10-02 09:02:54,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-02 09:02:54,807 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-02 09:02:54,807 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:54,808 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-02 09:02:54,808 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-02 09:02:54,809 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,809 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,810 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,810 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,810 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,810 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,811 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,811 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,812 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,812 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 09:02:54,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 09:02:54,812 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 09:02:54,813 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:54,813 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 09:02:54,813 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:54,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 09:02:54,815 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 09:02:54,815 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 09:02:54,815 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 09:02:54,815 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:02:54,815 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 09:02:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 09:02:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 09:02:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 09:02:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 09:02:54,815 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 09:02:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 09:02:54,819 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,820 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,820 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,820 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:54,820 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,820 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,820 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:54,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:54,820 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,820 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:54,820 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,820 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:02:54,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 09:02:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:54,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-02 09:02:54,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36eac773[Count = 1] remaining members to acquire global barrier 2023-10-02 09:02:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:54,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:54,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:54,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 09:02:54,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:54,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-02 09:02:54,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36eac773[Count = 0] remaining members to acquire global barrier 2023-10-02 09:02:54,824 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 09:02:54,825 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,826 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,826 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,826 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,826 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:02:54,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,826 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:02:54,826 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,826 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 09:02:54,826 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:02:54,826 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:02:54,826 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:02:54,826 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:02:54,827 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:02:54,827 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:02:54,827 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:54,827 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,827 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:02:54,827 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. started... 2023-10-02 09:02:54,827 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:54,830 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. started... 2023-10-02 09:02:54,830 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 09:02:54,830 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:54,830 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 09:02:54,830 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b656cbb5585fcbc19cacaf4c68053d7d 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-02 09:02:54,831 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 73171b469fa202184d2c9bc76c95f198 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-02 09:02:54,865 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231002318605db73e941e28856d922e4854053 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231002318605db73e941e28856d922e4854053 2023-10-02 09:02:54,869 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002f615eea4d95a40698407441002c8d657 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231002f615eea4d95a40698407441002c8d657 2023-10-02 09:02:54,885 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/.tmp/cf/f6b56867b83b42048a1f04e19da603a4 2023-10-02 09:02:54,886 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:02:54,888 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/.tmp/cf/d1722304dc884fd4b3302510ca0a56e0 2023-10-02 09:02:54,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 09:02:54,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:02:54,889 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:02:54,895 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/.tmp/cf/f6b56867b83b42048a1f04e19da603a4 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/cf/f6b56867b83b42048a1f04e19da603a4 2023-10-02 09:02:54,896 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/.tmp/cf/d1722304dc884fd4b3302510ca0a56e0 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/cf/d1722304dc884fd4b3302510ca0a56e0 2023-10-02 09:02:54,903 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/cf/d1722304dc884fd4b3302510ca0a56e0, entries=46, sequenceid=6, filesize=12.7 K 2023-10-02 09:02:54,904 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 73171b469fa202184d2c9bc76c95f198 in 74ms, sequenceid=6, compaction requested=false 2023-10-02 09:02:54,906 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73171b469fa202184d2c9bc76c95f198: 2023-10-02 09:02:54,906 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 09:02:54,907 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:02:54,907 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/cf/f6b56867b83b42048a1f04e19da603a4, entries=4, sequenceid=6, filesize=5.6 K 2023-10-02 09:02:54,907 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/cf/d1722304dc884fd4b3302510ca0a56e0] hfiles 2023-10-02 09:02:54,907 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/cf/d1722304dc884fd4b3302510ca0a56e0 for snapshot=snaptb0-testExportFileSystemState 2023-10-02 09:02:54,908 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b656cbb5585fcbc19cacaf4c68053d7d in 78ms, sequenceid=6, compaction requested=false 2023-10-02 09:02:54,908 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b656cbb5585fcbc19cacaf4c68053d7d: 2023-10-02 09:02:54,908 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 09:02:54,908 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:02:54,908 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/cf/f6b56867b83b42048a1f04e19da603a4] hfiles 2023-10-02 09:02:54,908 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/cf/f6b56867b83b42048a1f04e19da603a4 for snapshot=snaptb0-testExportFileSystemState 2023-10-02 09:02:54,927 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. completed. 2023-10-02 09:02:54,927 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:02:54,927 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:02:54,927 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:02:54,927 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,927 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 09:02:54,927 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:02:54,928 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. completed. 2023-10-02 09:02:54,928 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:02:54,928 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:02:54,928 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:02:54,928 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,928 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 09:02:54,928 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:02:54,944 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 09:02:54,944 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 09:02:54,944 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:54,944 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,944 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 09:02:54,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:54,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:54,944 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:54,946 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,946 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 09:02:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 09:02:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 09:02:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40077,1696237348884': 2023-10-02 09:02:54,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 09:02:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 09:02:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 09:02:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44871,1696237348922': 2023-10-02 09:02:54,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 09:02:54,955 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-02 09:02:54,955 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:02:54,955 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:02:54,955 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-02 09:02:54,955 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:02:54,957 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,957 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,957 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,957 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,958 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,958 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,957 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:02:54,958 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:02:54,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,959 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:02:54,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,959 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 09:02:54,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:02:54,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 09:02:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,963 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,963 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:02:54,964 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 09:02:54,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,967 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,967 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,968 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,968 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,968 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,968 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-02 09:02:54,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,968 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,968 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:02:54,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-02 09:02:54,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 09:02:54,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,968 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:02:54,968 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,969 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:02:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:02:54,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:02:54,968 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:02:54,970 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:02:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,971 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,971 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:02:54,971 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:02:54,971 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,971 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 09:02:54,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:02:54,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:02:54,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231002f615eea4d95a40698407441002c8d657, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231002318605db73e941e28856d922e4854053] mob files 2023-10-02 09:02:54,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231002f615eea4d95a40698407441002c8d657 2023-10-02 09:02:54,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231002318605db73e941e28856d922e4854053 2023-10-02 09:02:54,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-02 09:02:54,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 09:02:55,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 09:02:55,007 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-02 09:02:55,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 09:02:55,008 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 09:02:55,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696237374785Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696237374981 (+196 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696237374982 (+1 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1696237374982Writing data manifest for snaptb0-testExportFileSystemState at 1696237374986 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696237374998 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696237375007 (+9 ms) 2023-10-02 09:02:55,010 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 09:02:55,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 224 msec 2023-10-02 09:02:55,089 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:02:55,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 09:02:55,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:02:55,091 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237375091 2023-10-02 09:02:55,091 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44077, tgtDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237375091, rawTgtDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237375091, srcFsUri=hdfs://localhost:44077, srcDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:02:55,115 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:02:55,116 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1125500178_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237375091, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237375091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 09:02:55,116 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247, snapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-02 09:02:55,139 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237375091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 09:02:55,182 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:55,183 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:55,184 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:55,184 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:56,096 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-76184082568751229.jar 2023-10-02 09:02:56,097 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:56,097 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:56,164 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-7620418925369034496.jar 2023-10-02 09:02:56,165 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:56,165 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:56,166 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:56,166 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:56,166 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:56,167 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 09:02:56,167 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 09:02:56,167 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 09:02:56,168 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 09:02:56,168 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 09:02:56,169 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 09:02:56,169 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 09:02:56,170 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 09:02:56,170 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 09:02:56,170 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 09:02:56,171 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 09:02:56,171 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:02:56,172 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:02:56,172 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:02:56,173 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:02:56,173 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:02:56,173 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:02:56,174 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:02:56,686 WARN [Listener at jenkins-hbase4.apache.org/35395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 09:02:56,689 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-02 09:02:56,692 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-02 09:02:58,064 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:02:58,064 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:02:58,071 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0001_000001 (auth:SIMPLE) 2023-10-02 09:02:58,321 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0002_000001 (auth:SIMPLE) 2023-10-02 09:02:59,019 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 09:03:02,753 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0002_000001 (auth:SIMPLE) 2023-10-02 09:03:04,984 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0002_000001 (auth:SIMPLE) 2023-10-02 09:03:08,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0002_000001 (auth:SIMPLE) 2023-10-02 09:03:09,974 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 09:03:09,975 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 09:03:09,983 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-02 09:03:09,983 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 09:03:09,984 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 09:03:09,984 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 09:03:09,984 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-02 09:03:09,985 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-02 09:03:09,985 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237375091/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237375091/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 09:03:09,985 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237375091/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-02 09:03:09,985 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237375091/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-02 09:03:09,992 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-02 09:03:09,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-02 09:03:09,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-02 09:03:09,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 09:03:09,998 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237389998"}]},"ts":"1696237389998"} 2023-10-02 09:03:10,000 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-02 09:03:10,002 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-02 09:03:10,003 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b656cbb5585fcbc19cacaf4c68053d7d, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73171b469fa202184d2c9bc76c95f198, UNASSIGN}] 2023-10-02 09:03:10,005 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73171b469fa202184d2c9bc76c95f198, UNASSIGN 2023-10-02 09:03:10,005 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b656cbb5585fcbc19cacaf4c68053d7d, UNASSIGN 2023-10-02 09:03:10,006 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=73171b469fa202184d2c9bc76c95f198, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:10,006 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b656cbb5585fcbc19cacaf4c68053d7d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:10,006 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696237390006"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237390006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237390006"}]},"ts":"1696237390006"} 2023-10-02 09:03:10,006 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696237390006"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237390006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237390006"}]},"ts":"1696237390006"} 2023-10-02 09:03:10,008 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 73171b469fa202184d2c9bc76c95f198, server=jenkins-hbase4.apache.org,44871,1696237348922}] 2023-10-02 09:03:10,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure b656cbb5585fcbc19cacaf4c68053d7d, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:03:10,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 09:03:10,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 73171b469fa202184d2c9bc76c95f198 2023-10-02 09:03:10,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 73171b469fa202184d2c9bc76c95f198, disabling compactions & flushes 2023-10-02 09:03:10,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:03:10,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:03:10,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. after waiting 0 ms 2023-10-02 09:03:10,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:03:10,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:03:10,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b656cbb5585fcbc19cacaf4c68053d7d, disabling compactions & flushes 2023-10-02 09:03:10,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:03:10,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:03:10,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. after waiting 0 ms 2023-10-02 09:03:10,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:03:10,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:03:10,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:03:10,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:03:10,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:03:10,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d. 2023-10-02 09:03:10,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b656cbb5585fcbc19cacaf4c68053d7d: 2023-10-02 09:03:10,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198. 2023-10-02 09:03:10,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 73171b469fa202184d2c9bc76c95f198: 2023-10-02 09:03:10,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:03:10,176 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b656cbb5585fcbc19cacaf4c68053d7d, regionState=CLOSED 2023-10-02 09:03:10,176 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696237390176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237390176"}]},"ts":"1696237390176"} 2023-10-02 09:03:10,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 73171b469fa202184d2c9bc76c95f198 2023-10-02 09:03:10,177 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=73171b469fa202184d2c9bc76c95f198, regionState=CLOSED 2023-10-02 09:03:10,177 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696237390177"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237390177"}]},"ts":"1696237390177"} 2023-10-02 09:03:10,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-02 09:03:10,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure b656cbb5585fcbc19cacaf4c68053d7d, server=jenkins-hbase4.apache.org,40077,1696237348884 in 169 msec 2023-10-02 09:03:10,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-02 09:03:10,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 73171b469fa202184d2c9bc76c95f198, server=jenkins-hbase4.apache.org,44871,1696237348922 in 171 msec 2023-10-02 09:03:10,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b656cbb5585fcbc19cacaf4c68053d7d, UNASSIGN in 177 msec 2023-10-02 09:03:10,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-10-02 09:03:10,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=73171b469fa202184d2c9bc76c95f198, UNASSIGN in 178 msec 2023-10-02 09:03:10,184 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237390184"}]},"ts":"1696237390184"} 2023-10-02 09:03:10,185 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-02 09:03:10,187 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-02 09:03:10,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 194 msec 2023-10-02 09:03:10,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 09:03:10,301 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-02 09:03:10,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-02 09:03:10,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 09:03:10,306 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 09:03:10,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-02 09:03:10,306 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 09:03:10,308 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-02 09:03:10,311 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:03:10,311 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198 2023-10-02 09:03:10,312 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 09:03:10,312 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 09:03:10,312 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 09:03:10,312 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 09:03:10,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 09:03:10,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 09:03:10,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 09:03:10,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 09:03:10,315 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 09:03:10,315 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 09:03:10,315 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:10,315 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 09:03:10,315 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:10,316 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/recovered.edits] 2023-10-02 09:03:10,315 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:10,315 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 09:03:10,316 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:10,316 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/recovered.edits] 2023-10-02 09:03:10,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-02 09:03:10,321 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/cf/f6b56867b83b42048a1f04e19da603a4 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/cf/f6b56867b83b42048a1f04e19da603a4 2023-10-02 09:03:10,322 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/cf/d1722304dc884fd4b3302510ca0a56e0 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/cf/d1722304dc884fd4b3302510ca0a56e0 2023-10-02 09:03:10,325 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d/recovered.edits/9.seqid 2023-10-02 09:03:10,325 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198/recovered.edits/9.seqid 2023-10-02 09:03:10,326 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/b656cbb5585fcbc19cacaf4c68053d7d 2023-10-02 09:03:10,326 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemState/73171b469fa202184d2c9bc76c95f198 2023-10-02 09:03:10,326 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-02 09:03:10,327 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-02 09:03:10,328 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-02 09:03:10,332 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231002f615eea4d95a40698407441002c8d657 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231002f615eea4d95a40698407441002c8d657 2023-10-02 09:03:10,333 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231002318605db73e941e28856d922e4854053 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231002318605db73e941e28856d922e4854053 2023-10-02 09:03:10,334 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-02 09:03:10,336 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 09:03:10,339 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-02 09:03:10,341 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-02 09:03:10,343 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 09:03:10,343 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-02 09:03:10,343 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237390343"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:10,343 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237390343"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:10,346 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 09:03:10,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b656cbb5585fcbc19cacaf4c68053d7d, NAME => 'testtb-testExportFileSystemState,,1696237373718.b656cbb5585fcbc19cacaf4c68053d7d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 73171b469fa202184d2c9bc76c95f198, NAME => 'testtb-testExportFileSystemState,1,1696237373718.73171b469fa202184d2c9bc76c95f198.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 09:03:10,346 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-02 09:03:10,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696237390346"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:10,348 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-02 09:03:10,351 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 09:03:10,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 49 msec 2023-10-02 09:03:10,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-02 09:03:10,419 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-02 09:03:10,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-02 09:03:10,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-02 09:03:10,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-02 09:03:10,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-02 09:03:10,466 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 753) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:55422 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:35563 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1192376027_1 at /127.0.0.1:55408 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:47638 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1192376027_1 at /127.0.0.1:47610 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:49476 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 924) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=261 (was 287), ProcessCount=171 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=1432 (was 1587) 2023-10-02 09:03:10,466 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-02 09:03:10,486 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=261, ProcessCount=171, AvailableMemoryMB=1431 2023-10-02 09:03:10,486 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-02 09:03:10,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 09:03:10,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-02 09:03:10,493 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 09:03:10,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-02 09:03:10,494 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 09:03:10,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 09:03:10,497 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:10,497 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:10,498 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1 empty. 2023-10-02 09:03:10,498 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3 empty. 2023-10-02 09:03:10,498 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:10,498 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:10,498 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-02 09:03:10,510 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-02 09:03:10,511 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7e05e86b91c668846afc938e15dd8bc1, NAME => 'testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:03:10,512 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 372a28aa51fbbb622d3f1e93eb929bd3, NAME => 'testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 7e05e86b91c668846afc938e15dd8bc1, disabling compactions & flushes 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 372a28aa51fbbb622d3f1e93eb929bd3, disabling compactions & flushes 2023-10-02 09:03:10,526 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:10,526 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. after waiting 0 ms 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. after waiting 0 ms 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:10,526 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:10,526 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 7e05e86b91c668846afc938e15dd8bc1: 2023-10-02 09:03:10,526 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 372a28aa51fbbb622d3f1e93eb929bd3: 2023-10-02 09:03:10,529 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 09:03:10,530 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696237390530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237390530"}]},"ts":"1696237390530"} 2023-10-02 09:03:10,530 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696237390530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237390530"}]},"ts":"1696237390530"} 2023-10-02 09:03:10,533 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 09:03:10,534 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 09:03:10,534 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237390534"}]},"ts":"1696237390534"} 2023-10-02 09:03:10,536 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-02 09:03:10,540 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 09:03:10,541 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 09:03:10,541 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 09:03:10,541 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 09:03:10,541 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 09:03:10,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e05e86b91c668846afc938e15dd8bc1, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=372a28aa51fbbb622d3f1e93eb929bd3, ASSIGN}] 2023-10-02 09:03:10,545 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e05e86b91c668846afc938e15dd8bc1, ASSIGN 2023-10-02 09:03:10,545 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=372a28aa51fbbb622d3f1e93eb929bd3, ASSIGN 2023-10-02 09:03:10,546 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=372a28aa51fbbb622d3f1e93eb929bd3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39697,1696237348836; forceNewPlan=false, retain=false 2023-10-02 09:03:10,546 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e05e86b91c668846afc938e15dd8bc1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44871,1696237348922; forceNewPlan=false, retain=false 2023-10-02 09:03:10,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 09:03:10,696 INFO [jenkins-hbase4:39745] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 09:03:10,699 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7e05e86b91c668846afc938e15dd8bc1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:10,699 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=372a28aa51fbbb622d3f1e93eb929bd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:10,699 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696237390699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237390699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237390699"}]},"ts":"1696237390699"} 2023-10-02 09:03:10,699 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696237390699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237390699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237390699"}]},"ts":"1696237390699"} 2023-10-02 09:03:10,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 7e05e86b91c668846afc938e15dd8bc1, server=jenkins-hbase4.apache.org,44871,1696237348922}] 2023-10-02 09:03:10,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 372a28aa51fbbb622d3f1e93eb929bd3, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:03:10,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 09:03:10,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:10,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7e05e86b91c668846afc938e15dd8bc1, NAME => 'testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 09:03:10,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. service=AccessControlService 2023-10-02 09:03:10,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:10,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:03:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 372a28aa51fbbb622d3f1e93eb929bd3, NAME => 'testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 09:03:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. service=AccessControlService 2023-10-02 09:03:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:10,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:03:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:10,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:10,862 INFO [StoreOpener-7e05e86b91c668846afc938e15dd8bc1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:10,862 INFO [StoreOpener-372a28aa51fbbb622d3f1e93eb929bd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:10,864 DEBUG [StoreOpener-7e05e86b91c668846afc938e15dd8bc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/cf 2023-10-02 09:03:10,864 DEBUG [StoreOpener-7e05e86b91c668846afc938e15dd8bc1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/cf 2023-10-02 09:03:10,864 DEBUG [StoreOpener-372a28aa51fbbb622d3f1e93eb929bd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/cf 2023-10-02 09:03:10,864 DEBUG [StoreOpener-372a28aa51fbbb622d3f1e93eb929bd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/cf 2023-10-02 09:03:10,864 INFO [StoreOpener-372a28aa51fbbb622d3f1e93eb929bd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 372a28aa51fbbb622d3f1e93eb929bd3 columnFamilyName cf 2023-10-02 09:03:10,864 INFO [StoreOpener-7e05e86b91c668846afc938e15dd8bc1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e05e86b91c668846afc938e15dd8bc1 columnFamilyName cf 2023-10-02 09:03:10,866 INFO [StoreOpener-7e05e86b91c668846afc938e15dd8bc1-1] regionserver.HStore(310): Store=7e05e86b91c668846afc938e15dd8bc1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:03:10,866 INFO [StoreOpener-372a28aa51fbbb622d3f1e93eb929bd3-1] regionserver.HStore(310): Store=372a28aa51fbbb622d3f1e93eb929bd3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:03:10,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:10,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:10,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:10,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:10,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:10,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:10,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:03:10,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:03:10,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7e05e86b91c668846afc938e15dd8bc1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67917485, jitterRate=0.012049391865730286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:03:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7e05e86b91c668846afc938e15dd8bc1: 2023-10-02 09:03:10,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 372a28aa51fbbb622d3f1e93eb929bd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69035625, jitterRate=0.028710976243019104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:03:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 372a28aa51fbbb622d3f1e93eb929bd3: 2023-10-02 09:03:10,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1., pid=45, masterSystemTime=1696237390853 2023-10-02 09:03:10,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3., pid=46, masterSystemTime=1696237390854 2023-10-02 09:03:10,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:10,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:10,876 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7e05e86b91c668846afc938e15dd8bc1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:10,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:10,876 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696237390876"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237390876"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237390876"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237390876"}]},"ts":"1696237390876"} 2023-10-02 09:03:10,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:10,877 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=372a28aa51fbbb622d3f1e93eb929bd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:10,877 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696237390877"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237390877"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237390877"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237390877"}]},"ts":"1696237390877"} 2023-10-02 09:03:10,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-02 09:03:10,881 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 7e05e86b91c668846afc938e15dd8bc1, server=jenkins-hbase4.apache.org,44871,1696237348922 in 177 msec 2023-10-02 09:03:10,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-02 09:03:10,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 372a28aa51fbbb622d3f1e93eb929bd3, server=jenkins-hbase4.apache.org,39697,1696237348836 in 177 msec 2023-10-02 09:03:10,882 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e05e86b91c668846afc938e15dd8bc1, ASSIGN in 338 msec 2023-10-02 09:03:10,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-10-02 09:03:10,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=372a28aa51fbbb622d3f1e93eb929bd3, ASSIGN in 339 msec 2023-10-02 09:03:10,884 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 09:03:10,884 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237390884"}]},"ts":"1696237390884"} 2023-10-02 09:03:10,885 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-02 09:03:10,887 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 09:03:10,887 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-02 09:03:10,889 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 09:03:10,890 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:10,891 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:10,891 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:10,891 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:10,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:10,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:10,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:10,892 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:10,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 403 msec 2023-10-02 09:03:11,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 09:03:11,098 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-02 09:03:11,101 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-02 09:03:11,101 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:11,104 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:03:11,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 09:03:11,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237391117 (current time:1696237391117). 2023-10-02 09:03:11,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:03:11,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x5bb4e000 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:11,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31c5e38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:11,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:11,129 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:11,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bb4e000 to 127.0.0.1:60549 2023-10-02 09:03:11,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:11,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x6f4d6357 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:11,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13852a5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:11,142 DEBUG [hconnection-0x72094b88-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:11,144 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:11,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:11,150 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:11,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f4d6357 to 127.0.0.1:60549 2023-10-02 09:03:11,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:11,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 09:03:11,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:03:11,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 09:03:11,155 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:03:11,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 09:03:11,157 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 09:03:11,158 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696237991158 2023-10-02 09:03:11,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 09:03:11,158 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-02 09:03:11,159 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:03:11,159 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:03:11,162 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 09:03:11,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 09:03:11,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-10-02 09:03:11,165 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 09:03:11,166 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696237991166 2023-10-02 09:03:11,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,180 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-02 09:03:11,180 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:11,181 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-02 09:03:11,181 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-02 09:03:11,182 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,182 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,185 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,185 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,185 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,185 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,185 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,185 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,186 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,186 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:03:11,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 09:03:11,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 09:03:11,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 09:03:11,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 09:03:11,187 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,187 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 09:03:11,187 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:11,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,189 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 09:03:11,190 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 09:03:11,190 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 09:03:11,190 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:11,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,191 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 09:03:11,191 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 09:03:11,190 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 09:03:11,191 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 09:03:11,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 09:03:11,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,193 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 09:03:11,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,194 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 09:03:11,194 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:11,197 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 09:03:11,197 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 09:03:11,197 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 09:03:11,197 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,197 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,198 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:11,198 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,198 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:11,198 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,198 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:11,199 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:11,199 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:11,199 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,200 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:11,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-02 09:03:11,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b6e0d2b[Count = 1] remaining members to acquire global barrier 2023-10-02 09:03:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:11,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-02 09:03:11,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b6e0d2b[Count = 0] remaining members to acquire global barrier 2023-10-02 09:03:11,203 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-02 09:03:11,203 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,205 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,205 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,205 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,205 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 09:03:11,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,205 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,205 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:11,205 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 09:03:11,205 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:11,205 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:11,205 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:11,205 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,205 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:11,205 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 09:03:11,206 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. started... 2023-10-02 09:03:11,206 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 09:03:11,205 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:03:11,205 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:11,205 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. started... 2023-10-02 09:03:11,206 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7e05e86b91c668846afc938e15dd8bc1: 2023-10-02 09:03:11,206 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:03:11,207 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 372a28aa51fbbb622d3f1e93eb929bd3: 2023-10-02 09:03:11,208 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,208 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:11,208 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,208 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:03:11,209 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:11,209 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:03:11,217 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 09:03:11,217 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:11,217 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 09:03:11,229 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. completed. 2023-10-02 09:03:11,229 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:11,230 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:11,230 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:11,230 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,230 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 09:03:11,230 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. completed. 2023-10-02 09:03:11,230 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:11,230 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:03:11,230 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:11,230 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:11,230 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,230 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 09:03:11,230 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:03:11,233 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 09:03:11,233 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,233 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:11,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,233 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 09:03:11,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:11,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:11,235 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 09:03:11,235 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,235 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:11,235 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 09:03:11,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:11,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:11,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:11,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44871,1696237348922': 2023-10-02 09:03:11,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-02 09:03:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39697,1696237348836': 2023-10-02 09:03:11,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-02 09:03:11,242 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-02 09:03:11,242 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:03:11,242 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:03:11,242 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,242 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:03:11,245 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:11,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:11,245 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:11,246 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,246 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:11,247 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:11,250 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,250 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,251 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,253 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,253 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,253 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,253 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,254 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,254 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,253 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,253 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,254 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,254 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,254 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,254 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:11,254 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,255 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-02 09:03:11,254 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,256 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,256 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,256 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:03:11,256 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,256 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 09:03:11,259 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:11,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 09:03:11,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:03:11,261 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:03:11,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,292 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-02 09:03:11,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,293 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:11,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696237391158Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696237391265 (+107 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696237391265Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696237391265Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696237391269 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696237391286 (+17 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696237391292 (+6 ms) 2023-10-02 09:03:11,296 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 09:03:11,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 137 msec 2023-10-02 09:03:11,461 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:11,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 09:03:11,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:03:11,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44871] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:03:11,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39697] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:03:11,471 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-02 09:03:11,471 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:11,471 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:03:11,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 09:03:11,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237391482 (current time:1696237391482). 2023-10-02 09:03:11,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:03:11,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x1939c282 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:11,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@520f379, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:11,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:11,498 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:11,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1939c282 to 127.0.0.1:60549 2023-10-02 09:03:11,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:11,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x45b41489 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:11,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@124ef36f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:11,511 DEBUG [hconnection-0x10f77164-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:11,514 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:11,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:11,519 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45b41489 to 127.0.0.1:60549 2023-10-02 09:03:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 09:03:11,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:03:11,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 09:03:11,526 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:03:11,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 09:03:11,529 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 09:03:11,530 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696237991530 2023-10-02 09:03:11,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 09:03:11,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-02 09:03:11,531 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:03:11,531 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:03:11,532 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 09:03:11,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 09:03:11,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-10-02 09:03:11,535 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 09:03:11,535 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696237991535 2023-10-02 09:03:11,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-02 09:03:11,549 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-02 09:03:11,550 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:11,551 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-02 09:03:11,551 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-02 09:03:11,552 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,552 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,553 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,553 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,553 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,553 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,553 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,554 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,554 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,554 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:03:11,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 09:03:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 09:03:11,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 09:03:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 09:03:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 09:03:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:11,558 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 09:03:11,559 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 09:03:11,557 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 09:03:11,560 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 09:03:11,559 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 09:03:11,559 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 09:03:11,560 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 09:03:11,560 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 09:03:11,560 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 09:03:11,561 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,561 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:11,563 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,563 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 09:03:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:11,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-02 09:03:11,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2cc012[Count = 1] remaining members to acquire global barrier 2023-10-02 09:03:11,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:11,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:11,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:11,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:11,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 09:03:11,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:11,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-02 09:03:11,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2cc012[Count = 0] remaining members to acquire global barrier 2023-10-02 09:03:11,569 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-02 09:03:11,569 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,570 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,570 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,570 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 09:03:11,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,571 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 09:03:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 09:03:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:03:11,571 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:11,571 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. started... 2023-10-02 09:03:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 09:03:11,571 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,571 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:03:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:11,571 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7e05e86b91c668846afc938e15dd8bc1 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-02 09:03:11,571 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:11,572 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. started... 2023-10-02 09:03:11,572 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 372a28aa51fbbb622d3f1e93eb929bd3 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-02 09:03:11,577 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 09:03:11,577 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:11,577 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 09:03:11,599 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231002d1d2e9ce9bc44d4b9c75f03ba7e06bdc to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002d1d2e9ce9bc44d4b9c75f03ba7e06bdc 2023-10-02 09:03:11,607 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002e97e5bf4f9604bcb82c1bac8df137484 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002e97e5bf4f9604bcb82c1bac8df137484 2023-10-02 09:03:11,615 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/.tmp/cf/dc72ac43f88a44f78895cb836299d776 2023-10-02 09:03:11,616 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/.tmp/cf/b3fa175ba62d48dd8a6ad5c9acdb4ec5 2023-10-02 09:03:11,621 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/.tmp/cf/dc72ac43f88a44f78895cb836299d776 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/cf/dc72ac43f88a44f78895cb836299d776 2023-10-02 09:03:11,622 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/.tmp/cf/b3fa175ba62d48dd8a6ad5c9acdb4ec5 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/cf/b3fa175ba62d48dd8a6ad5c9acdb4ec5 2023-10-02 09:03:11,626 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/cf/dc72ac43f88a44f78895cb836299d776, entries=5, sequenceid=6, filesize=5.7 K 2023-10-02 09:03:11,627 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/cf/b3fa175ba62d48dd8a6ad5c9acdb4ec5, entries=45, sequenceid=6, filesize=12.4 K 2023-10-02 09:03:11,627 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 7e05e86b91c668846afc938e15dd8bc1 in 56ms, sequenceid=6, compaction requested=false 2023-10-02 09:03:11,627 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-02 09:03:11,628 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 372a28aa51fbbb622d3f1e93eb929bd3 in 56ms, sequenceid=6, compaction requested=false 2023-10-02 09:03:11,628 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7e05e86b91c668846afc938e15dd8bc1: 2023-10-02 09:03:11,630 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 372a28aa51fbbb622d3f1e93eb929bd3: 2023-10-02 09:03:11,630 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 09:03:11,630 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 09:03:11,630 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:11,630 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:11,630 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/cf/dc72ac43f88a44f78895cb836299d776] hfiles 2023-10-02 09:03:11,630 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/cf/b3fa175ba62d48dd8a6ad5c9acdb4ec5] hfiles 2023-10-02 09:03:11,630 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/cf/b3fa175ba62d48dd8a6ad5c9acdb4ec5 for snapshot=snaptb0-testConsecutiveExports 2023-10-02 09:03:11,630 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/cf/dc72ac43f88a44f78895cb836299d776 for snapshot=snaptb0-testConsecutiveExports 2023-10-02 09:03:11,631 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:11,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 09:03:11,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:03:11,633 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:03:11,641 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. completed. 2023-10-02 09:03:11,641 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 09:03:11,642 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:03:11,642 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. completed. 2023-10-02 09:03:11,642 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:11,642 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:11,642 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:11,642 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,642 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 09:03:11,642 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:03:11,643 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,643 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 09:03:11,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:11,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:11,643 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:11,644 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 09:03:11,645 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:11,645 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 09:03:11,646 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:11,646 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 09:03:11,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:11,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 09:03:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 09:03:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44871,1696237348922': 2023-10-02 09:03:11,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-02 09:03:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 09:03:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 09:03:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39697,1696237348836': 2023-10-02 09:03:11,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-02 09:03:11,653 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-02 09:03:11,653 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:03:11,653 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:03:11,653 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-02 09:03:11,653 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:03:11,655 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,655 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:11,655 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,655 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:11,655 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 09:03:11,659 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,660 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,660 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,660 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 09:03:11,661 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 09:03:11,663 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,664 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,664 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,683 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,683 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,684 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,684 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,683 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,683 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:11,684 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:11,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,684 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,684 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,686 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,684 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:11,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:11,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-02 09:03:11,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-02 09:03:11,686 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 09:03:11,686 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:11,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:11,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:03:11,687 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,687 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:11,687 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:11,687 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,687 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002e97e5bf4f9604bcb82c1bac8df137484, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002d1d2e9ce9bc44d4b9c75f03ba7e06bdc] mob files 2023-10-02 09:03:11,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002e97e5bf4f9604bcb82c1bac8df137484 2023-10-02 09:03:11,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002d1d2e9ce9bc44d4b9c75f03ba7e06bdc 2023-10-02 09:03:11,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-02 09:03:11,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-02 09:03:11,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,716 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696237391530Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696237391696 (+166 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696237391696Loading Region manifests for snaptb0-testConsecutiveExports at 1696237391696Writing data manifest for snaptb0-testConsecutiveExports at 1696237391700 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696237391708 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696237391716 (+8 ms) 2023-10-02 09:03:11,719 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 09:03:11,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 188 msec 2023-10-02 09:03:11,833 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:11,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 09:03:11,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:03:11,835 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835 2023-10-02 09:03:11,835 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835, srcFsUri=hdfs://localhost:44077, srcDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:03:11,857 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:03:11,857 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@79dd2088, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,857 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247, snapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-02 09:03:11,866 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 09:03:11,879 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:11,880 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:11,880 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:11,880 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:12,756 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-8271892340117782489.jar 2023-10-02 09:03:12,756 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:12,757 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:12,823 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-8808257127849432448.jar 2023-10-02 09:03:12,824 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:12,824 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:12,825 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:12,825 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:12,825 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:12,826 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:12,826 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 09:03:12,826 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 09:03:12,827 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 09:03:12,827 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 09:03:12,827 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 09:03:12,828 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 09:03:12,828 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 09:03:12,829 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 09:03:12,829 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 09:03:12,830 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 09:03:12,830 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:12,831 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:12,831 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:12,831 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:12,832 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:12,832 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:12,833 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:13,630 WARN [Listener at jenkins-hbase4.apache.org/35395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 09:03:13,632 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-02 09:03:13,634 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-02 09:03:14,395 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:03:14,395 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:03:14,399 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0002_000001 (auth:SIMPLE) 2023-10-02 09:03:15,191 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0003_000001 (auth:SIMPLE) 2023-10-02 09:03:15,767 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 09:03:19,101 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0003_000001 (auth:SIMPLE) 2023-10-02 09:03:21,320 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0003_000001 (auth:SIMPLE) 2023-10-02 09:03:23,726 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0003_000001 (auth:SIMPLE) 2023-10-02 09:03:24,811 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 09:03:24,811 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 09:03:24,816 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-02 09:03:24,816 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 09:03:24,817 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 09:03:24,817 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 09:03:24,820 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 09:03:24,820 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 09:03:24,820 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6ebe584e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 09:03:24,820 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 09:03:24,820 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 09:03:24,822 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835, srcFsUri=hdfs://localhost:44077, srcDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:03:24,844 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:03:24,844 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3e24d417, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 09:03:24,844 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247, snapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-02 09:03:24,855 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 09:03:24,867 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:24,868 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:24,868 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:24,868 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:25,742 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-5316349479446324412.jar 2023-10-02 09:03:25,743 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:25,743 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:25,809 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-4552197025591766122.jar 2023-10-02 09:03:25,810 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:25,810 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:25,810 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:25,811 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:25,811 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:25,811 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:25,812 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 09:03:25,812 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 09:03:25,813 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 09:03:25,813 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 09:03:25,814 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 09:03:25,814 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 09:03:25,814 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 09:03:25,815 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 09:03:25,815 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 09:03:25,816 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 09:03:25,816 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:25,817 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:25,817 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:25,817 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:25,818 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:25,818 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:25,819 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:26,218 WARN [Listener at jenkins-hbase4.apache.org/35395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 09:03:26,221 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-02 09:03:26,223 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-02 09:03:29,899 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:03:29,899 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:03:29,902 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0003_000001 (auth:SIMPLE) 2023-10-02 09:03:30,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0004_000001 (auth:SIMPLE) 2023-10-02 09:03:34,168 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0004_000001 (auth:SIMPLE) 2023-10-02 09:03:36,400 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0004_000001 (auth:SIMPLE) 2023-10-02 09:03:38,696 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0004_000001 (auth:SIMPLE) 2023-10-02 09:03:40,402 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 09:03:40,402 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 09:03:40,405 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-02 09:03:40,405 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 09:03:40,406 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 09:03:40,406 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 09:03:40,409 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 09:03:40,409 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 09:03:40,409 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6ebe584e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 09:03:40,409 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 09:03:40,409 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/local-export-1696237391835/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 09:03:40,422 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-02 09:03:40,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-02 09:03:40,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-02 09:03:40,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 09:03:40,427 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237420427"}]},"ts":"1696237420427"} 2023-10-02 09:03:40,429 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-02 09:03:40,431 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-02 09:03:40,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e05e86b91c668846afc938e15dd8bc1, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=372a28aa51fbbb622d3f1e93eb929bd3, UNASSIGN}] 2023-10-02 09:03:40,434 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=372a28aa51fbbb622d3f1e93eb929bd3, UNASSIGN 2023-10-02 09:03:40,434 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e05e86b91c668846afc938e15dd8bc1, UNASSIGN 2023-10-02 09:03:40,435 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=372a28aa51fbbb622d3f1e93eb929bd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:40,435 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7e05e86b91c668846afc938e15dd8bc1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:40,435 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696237420435"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237420435"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237420435"}]},"ts":"1696237420435"} 2023-10-02 09:03:40,435 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696237420435"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237420435"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237420435"}]},"ts":"1696237420435"} 2023-10-02 09:03:40,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 7e05e86b91c668846afc938e15dd8bc1, server=jenkins-hbase4.apache.org,44871,1696237348922}] 2023-10-02 09:03:40,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 372a28aa51fbbb622d3f1e93eb929bd3, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:03:40,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 09:03:40,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:40,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:40,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7e05e86b91c668846afc938e15dd8bc1, disabling compactions & flushes 2023-10-02 09:03:40,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:40,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 372a28aa51fbbb622d3f1e93eb929bd3, disabling compactions & flushes 2023-10-02 09:03:40,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:40,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:40,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. after waiting 0 ms 2023-10-02 09:03:40,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:40,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:40,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. after waiting 0 ms 2023-10-02 09:03:40,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:40,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:03:40,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:03:40,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:03:40,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:03:40,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1. 2023-10-02 09:03:40,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3. 2023-10-02 09:03:40,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7e05e86b91c668846afc938e15dd8bc1: 2023-10-02 09:03:40,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 372a28aa51fbbb622d3f1e93eb929bd3: 2023-10-02 09:03:40,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:40,603 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=372a28aa51fbbb622d3f1e93eb929bd3, regionState=CLOSED 2023-10-02 09:03:40,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:40,603 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696237420603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237420603"}]},"ts":"1696237420603"} 2023-10-02 09:03:40,604 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7e05e86b91c668846afc938e15dd8bc1, regionState=CLOSED 2023-10-02 09:03:40,604 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696237420604"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237420604"}]},"ts":"1696237420604"} 2023-10-02 09:03:40,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-02 09:03:40,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 372a28aa51fbbb622d3f1e93eb929bd3, server=jenkins-hbase4.apache.org,39697,1696237348836 in 167 msec 2023-10-02 09:03:40,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-02 09:03:40,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 7e05e86b91c668846afc938e15dd8bc1, server=jenkins-hbase4.apache.org,44871,1696237348922 in 169 msec 2023-10-02 09:03:40,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=372a28aa51fbbb622d3f1e93eb929bd3, UNASSIGN in 175 msec 2023-10-02 09:03:40,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-02 09:03:40,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7e05e86b91c668846afc938e15dd8bc1, UNASSIGN in 175 msec 2023-10-02 09:03:40,609 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237420609"}]},"ts":"1696237420609"} 2023-10-02 09:03:40,610 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-02 09:03:40,612 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-02 09:03:40,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 191 msec 2023-10-02 09:03:40,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 09:03:40,729 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-02 09:03:40,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-02 09:03:40,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 09:03:40,733 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 09:03:40,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-02 09:03:40,734 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 09:03:40,737 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-02 09:03:40,740 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:40,740 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:40,741 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 09:03:40,741 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 09:03:40,741 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 09:03:40,741 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 09:03:40,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 09:03:40,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 09:03:40,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 09:03:40,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 09:03:40,742 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 09:03:40,743 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:40,743 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 09:03:40,743 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:40,742 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 09:03:40,743 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 09:03:40,743 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/recovered.edits] 2023-10-02 09:03:40,743 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/recovered.edits] 2023-10-02 09:03:40,743 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:40,743 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:40,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-02 09:03:40,747 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/cf/dc72ac43f88a44f78895cb836299d776 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/cf/dc72ac43f88a44f78895cb836299d776 2023-10-02 09:03:40,747 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/cf/b3fa175ba62d48dd8a6ad5c9acdb4ec5 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/cf/b3fa175ba62d48dd8a6ad5c9acdb4ec5 2023-10-02 09:03:40,750 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1/recovered.edits/9.seqid 2023-10-02 09:03:40,751 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3/recovered.edits/9.seqid 2023-10-02 09:03:40,751 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/7e05e86b91c668846afc938e15dd8bc1 2023-10-02 09:03:40,751 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testConsecutiveExports/372a28aa51fbbb622d3f1e93eb929bd3 2023-10-02 09:03:40,751 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-02 09:03:40,752 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-02 09:03:40,752 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-02 09:03:40,755 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002e97e5bf4f9604bcb82c1bac8df137484 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002e97e5bf4f9604bcb82c1bac8df137484 2023-10-02 09:03:40,757 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002d1d2e9ce9bc44d4b9c75f03ba7e06bdc to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002d1d2e9ce9bc44d4b9c75f03ba7e06bdc 2023-10-02 09:03:40,757 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-02 09:03:40,759 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 09:03:40,762 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-02 09:03:40,764 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-02 09:03:40,765 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 09:03:40,765 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-02 09:03:40,765 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237420765"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:40,765 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237420765"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:40,767 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 09:03:40,767 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7e05e86b91c668846afc938e15dd8bc1, NAME => 'testtb-testConsecutiveExports,,1696237390488.7e05e86b91c668846afc938e15dd8bc1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 372a28aa51fbbb622d3f1e93eb929bd3, NAME => 'testtb-testConsecutiveExports,1,1696237390488.372a28aa51fbbb622d3f1e93eb929bd3.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 09:03:40,767 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-02 09:03:40,767 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696237420767"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:40,769 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-02 09:03:40,771 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 09:03:40,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-10-02 09:03:40,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-02 09:03:40,845 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-02 09:03:40,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-02 09:03:40,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-02 09:03:40,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-02 09:03:40,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-02 09:03:40,885 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 763), OpenFileDescriptor=905 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 261), ProcessCount=171 (was 171), AvailableMemoryMB=1298 (was 1431) 2023-10-02 09:03:40,885 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-10-02 09:03:40,908 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=171, AvailableMemoryMB=1297 2023-10-02 09:03:40,908 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-10-02 09:03:40,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 09:03:40,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:40,914 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 09:03:40,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-02 09:03:40,915 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 09:03:40,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 09:03:40,918 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:40,918 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:40,918 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399 empty. 2023-10-02 09:03:40,919 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f empty. 2023-10-02 09:03:40,919 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:40,919 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:40,919 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-02 09:03:40,931 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-02 09:03:40,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 81b3060fa0d636eacb54893618e5c399, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:03:40,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 058ea63a419721c267424486eb7cb94f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:03:40,948 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:40,948 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 058ea63a419721c267424486eb7cb94f, disabling compactions & flushes 2023-10-02 09:03:40,948 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:40,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:40,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:40,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 81b3060fa0d636eacb54893618e5c399, disabling compactions & flushes 2023-10-02 09:03:40,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. after waiting 0 ms 2023-10-02 09:03:40,949 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:40,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:40,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:40,949 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:40,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. after waiting 0 ms 2023-10-02 09:03:40,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 058ea63a419721c267424486eb7cb94f: 2023-10-02 09:03:40,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:40,949 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:40,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 81b3060fa0d636eacb54893618e5c399: 2023-10-02 09:03:40,952 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 09:03:40,953 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696237420953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237420953"}]},"ts":"1696237420953"} 2023-10-02 09:03:40,953 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696237420953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237420953"}]},"ts":"1696237420953"} 2023-10-02 09:03:40,961 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 09:03:40,962 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 09:03:40,962 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237420962"}]},"ts":"1696237420962"} 2023-10-02 09:03:40,964 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-02 09:03:40,968 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 09:03:40,970 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 09:03:40,970 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 09:03:40,970 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 09:03:40,970 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 09:03:40,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=81b3060fa0d636eacb54893618e5c399, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=058ea63a419721c267424486eb7cb94f, ASSIGN}] 2023-10-02 09:03:40,973 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=81b3060fa0d636eacb54893618e5c399, ASSIGN 2023-10-02 09:03:40,973 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=058ea63a419721c267424486eb7cb94f, ASSIGN 2023-10-02 09:03:40,974 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=81b3060fa0d636eacb54893618e5c399, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40077,1696237348884; forceNewPlan=false, retain=false 2023-10-02 09:03:40,974 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=058ea63a419721c267424486eb7cb94f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39697,1696237348836; forceNewPlan=false, retain=false 2023-10-02 09:03:41,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 09:03:41,124 INFO [jenkins-hbase4:39745] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 09:03:41,127 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=81b3060fa0d636eacb54893618e5c399, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,127 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=058ea63a419721c267424486eb7cb94f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,127 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696237421127"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237421127"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237421127"}]},"ts":"1696237421127"} 2023-10-02 09:03:41,127 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696237421127"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237421127"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237421127"}]},"ts":"1696237421127"} 2023-10-02 09:03:41,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 81b3060fa0d636eacb54893618e5c399, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:03:41,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 058ea63a419721c267424486eb7cb94f, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:03:41,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 09:03:41,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:41,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81b3060fa0d636eacb54893618e5c399, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 058ea63a419721c267424486eb7cb94f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. service=AccessControlService 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. service=AccessControlService 2023-10-02 09:03:41,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:03:41,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:41,290 INFO [StoreOpener-81b3060fa0d636eacb54893618e5c399-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:41,290 INFO [StoreOpener-058ea63a419721c267424486eb7cb94f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:41,291 DEBUG [StoreOpener-058ea63a419721c267424486eb7cb94f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/cf 2023-10-02 09:03:41,291 DEBUG [StoreOpener-058ea63a419721c267424486eb7cb94f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/cf 2023-10-02 09:03:41,291 DEBUG [StoreOpener-81b3060fa0d636eacb54893618e5c399-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/cf 2023-10-02 09:03:41,291 DEBUG [StoreOpener-81b3060fa0d636eacb54893618e5c399-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/cf 2023-10-02 09:03:41,292 INFO [StoreOpener-058ea63a419721c267424486eb7cb94f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 058ea63a419721c267424486eb7cb94f columnFamilyName cf 2023-10-02 09:03:41,292 INFO [StoreOpener-81b3060fa0d636eacb54893618e5c399-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81b3060fa0d636eacb54893618e5c399 columnFamilyName cf 2023-10-02 09:03:41,294 INFO [StoreOpener-058ea63a419721c267424486eb7cb94f-1] regionserver.HStore(310): Store=058ea63a419721c267424486eb7cb94f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:03:41,294 INFO [StoreOpener-81b3060fa0d636eacb54893618e5c399-1] regionserver.HStore(310): Store=81b3060fa0d636eacb54893618e5c399/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:03:41,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:41,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:41,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:41,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:41,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:41,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:41,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:03:41,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 058ea63a419721c267424486eb7cb94f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61067903, jitterRate=-0.09001733362674713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:03:41,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:03:41,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 058ea63a419721c267424486eb7cb94f: 2023-10-02 09:03:41,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 81b3060fa0d636eacb54893618e5c399; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71351054, jitterRate=0.06321355700492859}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:03:41,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 81b3060fa0d636eacb54893618e5c399: 2023-10-02 09:03:41,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f., pid=61, masterSystemTime=1696237421284 2023-10-02 09:03:41,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399., pid=60, masterSystemTime=1696237421281 2023-10-02 09:03:41,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:41,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:41,313 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=058ea63a419721c267424486eb7cb94f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,313 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696237421313"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237421313"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237421313"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237421313"}]},"ts":"1696237421313"} 2023-10-02 09:03:41,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:41,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:41,313 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=81b3060fa0d636eacb54893618e5c399, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,314 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696237421313"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237421313"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237421313"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237421313"}]},"ts":"1696237421313"} 2023-10-02 09:03:41,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-02 09:03:41,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 058ea63a419721c267424486eb7cb94f, server=jenkins-hbase4.apache.org,39697,1696237348836 in 185 msec 2023-10-02 09:03:41,318 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=058ea63a419721c267424486eb7cb94f, ASSIGN in 346 msec 2023-10-02 09:03:41,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-02 09:03:41,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 81b3060fa0d636eacb54893618e5c399, server=jenkins-hbase4.apache.org,40077,1696237348884 in 187 msec 2023-10-02 09:03:41,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-10-02 09:03:41,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=81b3060fa0d636eacb54893618e5c399, ASSIGN in 348 msec 2023-10-02 09:03:41,320 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 09:03:41,320 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237421320"}]},"ts":"1696237421320"} 2023-10-02 09:03:41,322 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-02 09:03:41,324 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 09:03:41,324 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-02 09:03:41,326 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 09:03:41,328 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:41,328 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:41,328 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:41,328 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:41,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:41,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:41,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:41,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:41,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 419 msec 2023-10-02 09:03:41,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 09:03:41,519 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-02 09:03:41,521 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,521 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:41,523 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:03:41,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 09:03:41,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237421535 (current time:1696237421535). 2023-10-02 09:03:41,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:03:41,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x52416002 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:41,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7747a3b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:41,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:41,548 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:41,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52416002 to 127.0.0.1:60549 2023-10-02 09:03:41,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:41,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x7d0e4f35 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:41,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@241671e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:41,556 DEBUG [hconnection-0x6e8644b6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:41,557 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:41,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:41,564 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:41,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d0e4f35 to 127.0.0.1:60549 2023-10-02 09:03:41,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:41,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 09:03:41,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:03:41,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 09:03:41,568 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:03:41,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 09:03:41,570 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 09:03:41,571 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696238021571 2023-10-02 09:03:41,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 09:03:41,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,572 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:03:41,572 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:03:41,573 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 09:03:41,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 09:03:41,574 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-02 09:03:41,575 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 09:03:41,575 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696238021575 2023-10-02 09:03:41,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,588 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-02 09:03:41,588 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:41,590 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-02 09:03:41,590 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-02 09:03:41,590 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,590 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,592 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:41,592 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:41,592 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:41,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:41,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:41,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:41,592 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:41,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:41,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:41,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,593 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,593 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,593 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,593 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:03:41,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 09:03:41,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 09:03:41,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 09:03:41,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 09:03:41,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 09:03:41,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 09:03:41,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,594 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 09:03:41,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,594 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 09:03:41,594 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 09:03:41,594 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:41,594 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:41,595 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 09:03:41,597 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 09:03:41,594 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:41,597 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 09:03:41,597 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 09:03:41,597 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 09:03:41,596 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 09:03:41,597 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 09:03:41,597 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 09:03:41,597 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 09:03:41,599 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,599 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,599 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,599 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:41,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:41,600 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:41,600 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,600 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:41,600 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,600 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:41,600 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,600 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:41,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 09:03:41,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@101a5071[Count = 1] remaining members to acquire global barrier 2023-10-02 09:03:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:41,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 09:03:41,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@101a5071[Count = 0] remaining members to acquire global barrier 2023-10-02 09:03:41,604 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-02 09:03:41,604 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,606 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,606 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,606 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,606 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,606 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 09:03:41,606 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 09:03:41,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,606 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,606 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:41,606 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:41,606 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 09:03:41,606 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 09:03:41,606 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:03:41,606 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. started... 2023-10-02 09:03:41,606 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:41,606 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:41,606 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. started... 2023-10-02 09:03:41,606 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:41,607 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:41,608 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 058ea63a419721c267424486eb7cb94f: 2023-10-02 09:03:41,606 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:03:41,607 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 81b3060fa0d636eacb54893618e5c399: 2023-10-02 09:03:41,608 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,608 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,608 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:41,608 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:41,608 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:03:41,608 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:03:41,614 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 09:03:41,615 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:41,615 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 09:03:41,620 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. completed. 2023-10-02 09:03:41,620 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:41,620 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:41,620 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:41,620 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,620 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 09:03:41,620 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:03:41,621 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. completed. 2023-10-02 09:03:41,621 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:41,621 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:41,621 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:41,621 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,621 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 09:03:41,621 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:03:41,622 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 09:03:41,622 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,622 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:41,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,622 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 09:03:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:41,624 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,624 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 09:03:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:41,624 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:41,624 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 09:03:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40077,1696237348884': 2023-10-02 09:03:41,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-02 09:03:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:41,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39697,1696237348836': 2023-10-02 09:03:41,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-02 09:03:41,632 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-02 09:03:41,632 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:03:41,632 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:03:41,632 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,632 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:03:41,634 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,634 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,634 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:41,634 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,634 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,634 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:41,635 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:41,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,634 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:41,635 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:41,635 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:41,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:41,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:41,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,637 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:41,638 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,638 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:41,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:41,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:41,642 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,642 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:41,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:41,642 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:41,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:41,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,642 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:03:41,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:41,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:41,644 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,645 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,645 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,645 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,645 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 09:03:41,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,672 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:41,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 09:03:41,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:03:41,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,673 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:03:41,674 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-02 09:03:41,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,675 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696237421571Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696237421654 (+83 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696237421654Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696237421654Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696237421661 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696237421668 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696237421674 (+6 ms) 2023-10-02 09:03:41,677 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 09:03:41,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 105 msec 2023-10-02 09:03:41,874 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:41,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 09:03:41,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:03:41,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40077] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:03:41,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39697] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:03:41,882 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,882 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:41,883 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:03:41,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 09:03:41,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237421892 (current time:1696237421892). 2023-10-02 09:03:41,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:03:41,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x2991e355 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:41,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78fc72f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:41,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:41,903 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:41,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2991e355 to 127.0.0.1:60549 2023-10-02 09:03:41,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:41,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x6a4d6ce1 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:41,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ce0a1b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:41,912 DEBUG [hconnection-0x57900917-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:41,914 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:41,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:41,920 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:41,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a4d6ce1 to 127.0.0.1:60549 2023-10-02 09:03:41,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:41,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 09:03:41,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:03:41,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 09:03:41,925 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:03:41,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 09:03:41,927 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 09:03:41,928 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696238021928 2023-10-02 09:03:41,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 09:03:41,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,929 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:03:41,929 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:03:41,930 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 09:03:41,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 09:03:41,931 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-02 09:03:41,932 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 09:03:41,932 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696238021932 2023-10-02 09:03:41,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,941 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-02 09:03:41,941 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:41,942 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-02 09:03:41,942 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-02 09:03:41,942 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,942 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,944 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:41,944 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:41,944 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:41,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:41,944 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:41,944 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:41,944 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,944 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,945 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 09:03:41,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 09:03:41,946 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:41,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,947 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 09:03:41,947 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 09:03:41,947 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 09:03:41,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,947 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 09:03:41,947 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 09:03:41,947 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:41,947 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 09:03:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 09:03:41,949 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 09:03:41,948 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 09:03:41,949 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 09:03:41,949 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 09:03:41,950 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:41,950 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,951 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,951 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,951 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:41,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:41,951 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,951 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,951 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,951 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:41,952 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,952 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:41,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 09:03:41,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70abcc5e[Count = 1] remaining members to acquire global barrier 2023-10-02 09:03:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:41,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:41,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:41,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:41,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 09:03:41,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70abcc5e[Count = 0] remaining members to acquire global barrier 2023-10-02 09:03:41,955 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-02 09:03:41,955 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,957 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,957 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,957 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 09:03:41,958 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:41,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 09:03:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 09:03:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 09:03:41,958 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:41,958 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:41,958 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:03:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:41,958 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:41,958 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. started... 2023-10-02 09:03:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:03:41,958 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. started... 2023-10-02 09:03:41,959 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 81b3060fa0d636eacb54893618e5c399 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-02 09:03:41,959 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 058ea63a419721c267424486eb7cb94f 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-02 09:03:41,960 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 09:03:41,960 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:41,960 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 09:03:41,976 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310025c8e91728a0444279ae34af6eaf58222 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310025c8e91728a0444279ae34af6eaf58222 2023-10-02 09:03:41,976 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310027af427f001804aec90de59df4767901d to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310027af427f001804aec90de59df4767901d 2023-10-02 09:03:41,986 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/.tmp/cf/e1a3a60188ad488c97d599fe6376f199 2023-10-02 09:03:41,987 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/.tmp/cf/71a0111327ef4d60afd0c09a88775ac5 2023-10-02 09:03:41,992 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/.tmp/cf/e1a3a60188ad488c97d599fe6376f199 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/cf/e1a3a60188ad488c97d599fe6376f199 2023-10-02 09:03:41,992 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/.tmp/cf/71a0111327ef4d60afd0c09a88775ac5 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/cf/71a0111327ef4d60afd0c09a88775ac5 2023-10-02 09:03:41,996 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/cf/71a0111327ef4d60afd0c09a88775ac5, entries=45, sequenceid=6, filesize=13.2 K 2023-10-02 09:03:41,996 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/cf/e1a3a60188ad488c97d599fe6376f199, entries=5, sequenceid=6, filesize=5.8 K 2023-10-02 09:03:41,997 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 81b3060fa0d636eacb54893618e5c399 in 39ms, sequenceid=6, compaction requested=false 2023-10-02 09:03:41,997 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 058ea63a419721c267424486eb7cb94f in 38ms, sequenceid=6, compaction requested=false 2023-10-02 09:03:41,997 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-02 09:03:41,997 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-02 09:03:42,001 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 058ea63a419721c267424486eb7cb94f: 2023-10-02 09:03:42,001 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 81b3060fa0d636eacb54893618e5c399: 2023-10-02 09:03:42,001 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,001 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,001 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:42,001 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:42,001 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/cf/71a0111327ef4d60afd0c09a88775ac5] hfiles 2023-10-02 09:03:42,001 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/cf/e1a3a60188ad488c97d599fe6376f199] hfiles 2023-10-02 09:03:42,001 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/cf/e1a3a60188ad488c97d599fe6376f199 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,001 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/cf/71a0111327ef4d60afd0c09a88775ac5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,009 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. completed. 2023-10-02 09:03:42,010 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:42,010 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. completed. 2023-10-02 09:03:42,010 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:42,010 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:42,010 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,010 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:42,010 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 09:03:42,010 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:03:42,010 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:42,010 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:42,010 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,010 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 09:03:42,010 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:03:42,011 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 09:03:42,011 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,011 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,012 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 09:03:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:42,013 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,013 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 09:03:42,013 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:42,013 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 09:03:42,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:42,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:42,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:42,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:42,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39697,1696237348836': 2023-10-02 09:03:42,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-02 09:03:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:42,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:42,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:42,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:42,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40077,1696237348884': 2023-10-02 09:03:42,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-02 09:03:42,020 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-02 09:03:42,021 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:03:42,021 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:03:42,021 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,021 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:03:42,025 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,025 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,025 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:42,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,025 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,025 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,026 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:42,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,026 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:42,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:42,026 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:42,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:42,028 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:42,028 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,030 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:42,031 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,031 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 09:03:42,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:03:42,032 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:03:42,033 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:42,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,036 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,036 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:42,036 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,036 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:42,036 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:42,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:42,036 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:42,036 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:42,036 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:42,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:42,036 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,038 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:42,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,038 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:42,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:03:42,038 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:42,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:42,038 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:42,038 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,039 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,039 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:42,039 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:42,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:42,039 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,039 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:42,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:42,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:42,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:42,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310027af427f001804aec90de59df4767901d, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310025c8e91728a0444279ae34af6eaf58222] mob files 2023-10-02 09:03:42,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310027af427f001804aec90de59df4767901d 2023-10-02 09:03:42,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310025c8e91728a0444279ae34af6eaf58222 2023-10-02 09:03:42,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-02 09:03:42,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,079 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:42,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696237421928Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696237422055 (+127 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696237422055Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696237422055Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696237422060 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696237422072 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696237422079 (+7 ms) 2023-10-02 09:03:42,082 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 09:03:42,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 153 msec 2023-10-02 09:03:42,232 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:42,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 09:03:42,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:03:42,262 DEBUG [Listener at jenkins-hbase4.apache.org/35395] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 09:03:42,266 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 09:03:42,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39697] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 09:03:42,268 DEBUG [Listener at jenkins-hbase4.apache.org/35395] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 09:03:42,271 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 09:03:42,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40077] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 09:03:42,271 DEBUG [Listener at jenkins-hbase4.apache.org/35395] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 09:03:42,274 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 09:03:42,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44871] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 09:03:42,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-02 09:03:42,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:42,279 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 09:03:42,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-02 09:03:42,280 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 09:03:42,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 09:03:42,282 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312 2023-10-02 09:03:42,282 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:42,283 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312 empty. 2023-10-02 09:03:42,283 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876 empty. 2023-10-02 09:03:42,283 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312 2023-10-02 09:03:42,283 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:42,283 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-02 09:03:42,293 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-02 09:03:42,295 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => c9a30554609c235370e642a7f5074312, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:03:42,295 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 13e853a70524d86bf22be4ded57f4876, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing c9a30554609c235370e642a7f5074312, disabling compactions & flushes 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:42,303 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 13e853a70524d86bf22be4ded57f4876, disabling compactions & flushes 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:42,303 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. after waiting 0 ms 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. after waiting 0 ms 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:42,303 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:42,303 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for c9a30554609c235370e642a7f5074312: 2023-10-02 09:03:42,303 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 13e853a70524d86bf22be4ded57f4876: 2023-10-02 09:03:42,306 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 09:03:42,307 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696237422306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237422306"}]},"ts":"1696237422306"} 2023-10-02 09:03:42,307 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696237422306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237422306"}]},"ts":"1696237422306"} 2023-10-02 09:03:42,309 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 09:03:42,310 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 09:03:42,310 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237422310"}]},"ts":"1696237422310"} 2023-10-02 09:03:42,311 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-02 09:03:42,314 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 09:03:42,315 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 09:03:42,315 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 09:03:42,315 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 09:03:42,315 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 09:03:42,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9a30554609c235370e642a7f5074312, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13e853a70524d86bf22be4ded57f4876, ASSIGN}] 2023-10-02 09:03:42,318 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9a30554609c235370e642a7f5074312, ASSIGN 2023-10-02 09:03:42,318 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13e853a70524d86bf22be4ded57f4876, ASSIGN 2023-10-02 09:03:42,318 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9a30554609c235370e642a7f5074312, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39697,1696237348836; forceNewPlan=false, retain=false 2023-10-02 09:03:42,318 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13e853a70524d86bf22be4ded57f4876, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40077,1696237348884; forceNewPlan=false, retain=false 2023-10-02 09:03:42,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 09:03:42,469 INFO [jenkins-hbase4:39745] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 09:03:42,471 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=13e853a70524d86bf22be4ded57f4876, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,471 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c9a30554609c235370e642a7f5074312, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,472 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696237422471"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237422471"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237422471"}]},"ts":"1696237422471"} 2023-10-02 09:03:42,472 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696237422471"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237422471"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237422471"}]},"ts":"1696237422471"} 2023-10-02 09:03:42,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 13e853a70524d86bf22be4ded57f4876, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:03:42,474 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure c9a30554609c235370e642a7f5074312, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:03:42,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 09:03:42,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:42,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:42,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 13e853a70524d86bf22be4ded57f4876, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876.', STARTKEY => '2', ENDKEY => ''} 2023-10-02 09:03:42,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9a30554609c235370e642a7f5074312, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312.', STARTKEY => '', ENDKEY => '2'} 2023-10-02 09:03:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. service=AccessControlService 2023-10-02 09:03:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. service=AccessControlService 2023-10-02 09:03:42,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:03:42,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:03:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c9a30554609c235370e642a7f5074312 2023-10-02 09:03:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c9a30554609c235370e642a7f5074312 2023-10-02 09:03:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c9a30554609c235370e642a7f5074312 2023-10-02 09:03:42,631 INFO [StoreOpener-c9a30554609c235370e642a7f5074312-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c9a30554609c235370e642a7f5074312 2023-10-02 09:03:42,632 INFO [StoreOpener-13e853a70524d86bf22be4ded57f4876-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:42,633 DEBUG [StoreOpener-c9a30554609c235370e642a7f5074312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/cf 2023-10-02 09:03:42,633 DEBUG [StoreOpener-13e853a70524d86bf22be4ded57f4876-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/cf 2023-10-02 09:03:42,633 DEBUG [StoreOpener-c9a30554609c235370e642a7f5074312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/cf 2023-10-02 09:03:42,633 DEBUG [StoreOpener-13e853a70524d86bf22be4ded57f4876-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/cf 2023-10-02 09:03:42,634 INFO [StoreOpener-c9a30554609c235370e642a7f5074312-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9a30554609c235370e642a7f5074312 columnFamilyName cf 2023-10-02 09:03:42,634 INFO [StoreOpener-13e853a70524d86bf22be4ded57f4876-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13e853a70524d86bf22be4ded57f4876 columnFamilyName cf 2023-10-02 09:03:42,634 INFO [StoreOpener-c9a30554609c235370e642a7f5074312-1] regionserver.HStore(310): Store=c9a30554609c235370e642a7f5074312/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:03:42,634 INFO [StoreOpener-13e853a70524d86bf22be4ded57f4876-1] regionserver.HStore(310): Store=13e853a70524d86bf22be4ded57f4876/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:03:42,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312 2023-10-02 09:03:42,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:42,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312 2023-10-02 09:03:42,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:42,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:42,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c9a30554609c235370e642a7f5074312 2023-10-02 09:03:42,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:03:42,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:03:42,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 13e853a70524d86bf22be4ded57f4876; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62193663, jitterRate=-0.0732422024011612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:03:42,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 13e853a70524d86bf22be4ded57f4876: 2023-10-02 09:03:42,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c9a30554609c235370e642a7f5074312; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68744983, jitterRate=0.024380072951316833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:03:42,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c9a30554609c235370e642a7f5074312: 2023-10-02 09:03:42,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876., pid=69, masterSystemTime=1696237422625 2023-10-02 09:03:42,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312., pid=70, masterSystemTime=1696237422625 2023-10-02 09:03:42,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:42,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:42,644 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=13e853a70524d86bf22be4ded57f4876, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:42,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:42,644 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696237422644"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237422644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237422644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237422644"}]},"ts":"1696237422644"} 2023-10-02 09:03:42,644 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c9a30554609c235370e642a7f5074312, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,645 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696237422644"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237422644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237422644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237422644"}]},"ts":"1696237422644"} 2023-10-02 09:03:42,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-02 09:03:42,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 13e853a70524d86bf22be4ded57f4876, server=jenkins-hbase4.apache.org,40077,1696237348884 in 172 msec 2023-10-02 09:03:42,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-02 09:03:42,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure c9a30554609c235370e642a7f5074312, server=jenkins-hbase4.apache.org,39697,1696237348836 in 172 msec 2023-10-02 09:03:42,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13e853a70524d86bf22be4ded57f4876, ASSIGN in 333 msec 2023-10-02 09:03:42,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-02 09:03:42,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9a30554609c235370e642a7f5074312, ASSIGN in 333 msec 2023-10-02 09:03:42,650 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 09:03:42,651 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237422650"}]},"ts":"1696237422650"} 2023-10-02 09:03:42,652 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-02 09:03:42,658 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 09:03:42,659 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-02 09:03:42,661 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-02 09:03:42,662 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:42,662 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:42,662 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:42,662 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:42,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:42,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:42,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:42,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:42,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:42,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:42,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:42,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:42,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 388 msec 2023-10-02 09:03:42,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 09:03:42,884 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-02 09:03:42,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions c9a30554609c235370e642a7f5074312, 13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:42,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c9a30554609c235370e642a7f5074312, 13e853a70524d86bf22be4ded57f4876], force=true 2023-10-02 09:03:42,919 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c9a30554609c235370e642a7f5074312, 13e853a70524d86bf22be4ded57f4876], force=true 2023-10-02 09:03:42,919 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c9a30554609c235370e642a7f5074312, 13e853a70524d86bf22be4ded57f4876], force=true 2023-10-02 09:03:42,919 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c9a30554609c235370e642a7f5074312, 13e853a70524d86bf22be4ded57f4876], force=true 2023-10-02 09:03:42,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 09:03:42,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9a30554609c235370e642a7f5074312, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13e853a70524d86bf22be4ded57f4876, UNASSIGN}] 2023-10-02 09:03:42,946 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9a30554609c235370e642a7f5074312, UNASSIGN 2023-10-02 09:03:42,947 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13e853a70524d86bf22be4ded57f4876, UNASSIGN 2023-10-02 09:03:42,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c9a30554609c235370e642a7f5074312, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:42,947 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=13e853a70524d86bf22be4ded57f4876, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:42,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696237422947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237422947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237422947"}]},"ts":"1696237422947"} 2023-10-02 09:03:42,948 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696237422947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237422947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237422947"}]},"ts":"1696237422947"} 2023-10-02 09:03:42,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure c9a30554609c235370e642a7f5074312, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:03:42,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 13e853a70524d86bf22be4ded57f4876, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:03:43,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 09:03:43,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c9a30554609c235370e642a7f5074312 2023-10-02 09:03:43,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c9a30554609c235370e642a7f5074312, disabling compactions & flushes 2023-10-02 09:03:43,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:43,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:43,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. after waiting 0 ms 2023-10-02 09:03:43,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:43,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c9a30554609c235370e642a7f5074312 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-02 09:03:43,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 13e853a70524d86bf22be4ded57f4876, disabling compactions & flushes 2023-10-02 09:03:43,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. after waiting 0 ms 2023-10-02 09:03:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:43,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 13e853a70524d86bf22be4ded57f4876 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-02 09:03:43,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/.tmp/cf/2682bf17f6934495ada99101fc9ecf04 2023-10-02 09:03:43,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/.tmp/cf/a65927db8bbe4b56be5b8e172fb0efb3 2023-10-02 09:03:43,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/.tmp/cf/a65927db8bbe4b56be5b8e172fb0efb3 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/cf/a65927db8bbe4b56be5b8e172fb0efb3 2023-10-02 09:03:43,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/.tmp/cf/2682bf17f6934495ada99101fc9ecf04 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/cf/2682bf17f6934495ada99101fc9ecf04 2023-10-02 09:03:43,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/cf/a65927db8bbe4b56be5b8e172fb0efb3, entries=1, sequenceid=5, filesize=4.7 K 2023-10-02 09:03:43,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/cf/2682bf17f6934495ada99101fc9ecf04, entries=1, sequenceid=5, filesize=4.7 K 2023-10-02 09:03:43,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c9a30554609c235370e642a7f5074312 in 33ms, sequenceid=5, compaction requested=false 2023-10-02 09:03:43,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-02 09:03:43,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 13e853a70524d86bf22be4ded57f4876 in 32ms, sequenceid=5, compaction requested=false 2023-10-02 09:03:43,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-02 09:03:43,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-02 09:03:43,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-02 09:03:43,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:03:43,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:03:43,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876. 2023-10-02 09:03:43,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 13e853a70524d86bf22be4ded57f4876: 2023-10-02 09:03:43,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312. 2023-10-02 09:03:43,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c9a30554609c235370e642a7f5074312: 2023-10-02 09:03:43,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:43,150 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=13e853a70524d86bf22be4ded57f4876, regionState=CLOSED 2023-10-02 09:03:43,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c9a30554609c235370e642a7f5074312 2023-10-02 09:03:43,150 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696237423150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237423150"}]},"ts":"1696237423150"} 2023-10-02 09:03:43,151 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c9a30554609c235370e642a7f5074312, regionState=CLOSED 2023-10-02 09:03:43,151 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696237423151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237423151"}]},"ts":"1696237423151"} 2023-10-02 09:03:43,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-02 09:03:43,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 13e853a70524d86bf22be4ded57f4876, server=jenkins-hbase4.apache.org,40077,1696237348884 in 202 msec 2023-10-02 09:03:43,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-02 09:03:43,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure c9a30554609c235370e642a7f5074312, server=jenkins-hbase4.apache.org,39697,1696237348836 in 203 msec 2023-10-02 09:03:43,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=13e853a70524d86bf22be4ded57f4876, UNASSIGN in 209 msec 2023-10-02 09:03:43,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-02 09:03:43,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c9a30554609c235370e642a7f5074312, UNASSIGN in 213 msec 2023-10-02 09:03:43,197 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-02 09:03:43,200 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422276.c9a30554609c235370e642a7f5074312.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:43,200 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696237422276.13e853a70524d86bf22be4ded57f4876.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:43,200 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:43,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 09:03:43,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae7e780d2959335660eaac9770fefa47, ASSIGN}] 2023-10-02 09:03:43,252 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae7e780d2959335660eaac9770fefa47, ASSIGN 2023-10-02 09:03:43,253 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae7e780d2959335660eaac9770fefa47, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39697,1696237348836; forceNewPlan=false, retain=false 2023-10-02 09:03:43,403 INFO [jenkins-hbase4:39745] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 09:03:43,405 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ae7e780d2959335660eaac9770fefa47, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:43,405 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696237423405"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237423405"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237423405"}]},"ts":"1696237423405"} 2023-10-02 09:03:43,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure ae7e780d2959335660eaac9770fefa47, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:03:43,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 09:03:43,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. 2023-10-02 09:03:43,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae7e780d2959335660eaac9770fefa47, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.', STARTKEY => '', ENDKEY => ''} 2023-10-02 09:03:43,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. service=AccessControlService 2023-10-02 09:03:43,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:03:43,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:43,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:43,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:43,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:43,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/.regioninfo 2023-10-02 09:03:43,572 INFO [StoreOpener-ae7e780d2959335660eaac9770fefa47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:43,573 DEBUG [StoreOpener-ae7e780d2959335660eaac9770fefa47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf 2023-10-02 09:03:43,573 DEBUG [StoreOpener-ae7e780d2959335660eaac9770fefa47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf 2023-10-02 09:03:43,573 INFO [StoreOpener-ae7e780d2959335660eaac9770fefa47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae7e780d2959335660eaac9770fefa47 columnFamilyName cf 2023-10-02 09:03:43,601 DEBUG [StoreOpener-ae7e780d2959335660eaac9770fefa47-1] regionserver.HStore(539): loaded hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf/2682bf17f6934495ada99101fc9ecf04.13e853a70524d86bf22be4ded57f4876->hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/cf/2682bf17f6934495ada99101fc9ecf04-top 2023-10-02 09:03:43,606 DEBUG [StoreOpener-ae7e780d2959335660eaac9770fefa47-1] regionserver.HStore(539): loaded hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf/a65927db8bbe4b56be5b8e172fb0efb3.c9a30554609c235370e642a7f5074312->hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/cf/a65927db8bbe4b56be5b8e172fb0efb3-top 2023-10-02 09:03:43,607 INFO [StoreOpener-ae7e780d2959335660eaac9770fefa47-1] regionserver.HStore(310): Store=ae7e780d2959335660eaac9770fefa47/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:03:43,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:43,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:43,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:43,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ae7e780d2959335660eaac9770fefa47; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73364623, jitterRate=0.09321807324886322}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:03:43,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ae7e780d2959335660eaac9770fefa47: 2023-10-02 09:03:43,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47., pid=77, masterSystemTime=1696237423559 2023-10-02 09:03:43,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.,because compaction is disabled. 2023-10-02 09:03:43,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. 2023-10-02 09:03:43,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. 2023-10-02 09:03:43,616 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ae7e780d2959335660eaac9770fefa47, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:43,616 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696237423616"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237423616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237423616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237423616"}]},"ts":"1696237423616"} 2023-10-02 09:03:43,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-02 09:03:43,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure ae7e780d2959335660eaac9770fefa47, server=jenkins-hbase4.apache.org,39697,1696237348836 in 210 msec 2023-10-02 09:03:43,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-02 09:03:43,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae7e780d2959335660eaac9770fefa47, ASSIGN in 368 msec 2023-10-02 09:03:43,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c9a30554609c235370e642a7f5074312, 13e853a70524d86bf22be4ded57f4876], force=true in 710 msec 2023-10-02 09:03:44,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 09:03:44,026 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-02 09:03:44,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 09:03:44,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237424027 (current time:1696237424027). 2023-10-02 09:03:44,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:03:44,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x1fbbf37a to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:44,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f4b925a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:44,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:44,038 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:44,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fbbf37a to 127.0.0.1:60549 2023-10-02 09:03:44,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:44,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x2a08af75 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:44,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ae8a96d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:44,046 DEBUG [hconnection-0x79a22f28-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:44,049 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:44,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:44,055 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:44,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a08af75 to 127.0.0.1:60549 2023-10-02 09:03:44,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:44,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-02 09:03:44,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:03:44,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 09:03:44,059 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:03:44,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 09:03:44,062 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 09:03:44,062 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696238024062 2023-10-02 09:03:44,062 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 09:03:44,066 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:03:44,066 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:03:44,066 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 09:03:44,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 09:03:44,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-02 09:03:44,068 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 09:03:44,069 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696238024069 2023-10-02 09:03:44,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,079 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-02 09:03:44,079 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:44,081 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-02 09:03:44,081 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-02 09:03:44,081 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,081 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,083 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:44,083 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:44,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:44,083 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:44,083 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:44,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:44,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:44,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:44,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:44,083 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,083 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:03:44,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,084 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 09:03:44,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,084 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:44,085 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 09:03:44,086 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 09:03:44,086 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 09:03:44,086 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 09:03:44,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,086 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:44,086 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 09:03:44,087 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 09:03:44,087 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 09:03:44,087 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:44,087 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 09:03:44,088 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 09:03:44,088 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 09:03:44,088 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 09:03:44,090 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,091 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,091 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:44,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:44,091 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,091 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:44,091 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,092 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:44,091 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:44,092 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,092 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:44,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:44,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:44,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:44,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:44,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-02 09:03:44,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b878035[Count = 0] remaining members to acquire global barrier 2023-10-02 09:03:44,093 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-02 09:03:44,094 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,095 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,095 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,095 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 09:03:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 09:03:44,095 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,095 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:03:44,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:03:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 09:03:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 09:03:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 09:03:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:03:44,095 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. 2023-10-02 09:03:44,096 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. started... 2023-10-02 09:03:44,097 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae7e780d2959335660eaac9770fefa47: 2023-10-02 09:03:44,097 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,097 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:44,098 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf/2682bf17f6934495ada99101fc9ecf04.13e853a70524d86bf22be4ded57f4876->hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/cf/2682bf17f6934495ada99101fc9ecf04-top, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf/a65927db8bbe4b56be5b8e172fb0efb3.c9a30554609c235370e642a7f5074312->hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/cf/a65927db8bbe4b56be5b8e172fb0efb3-top] hfiles 2023-10-02 09:03:44,098 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf/2682bf17f6934495ada99101fc9ecf04.13e853a70524d86bf22be4ded57f4876 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,098 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 09:03:44,098 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:44,098 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 09:03:44,099 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf/a65927db8bbe4b56be5b8e172fb0efb3.c9a30554609c235370e642a7f5074312 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,100 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 09:03:44,100 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:44,100 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 09:03:44,110 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. completed. 2023-10-02 09:03:44,110 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. 2023-10-02 09:03:44,110 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:44,110 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:44,110 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,110 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 09:03:44,110 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:03:44,114 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 09:03:44,114 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,114 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:44,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:44,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:44,114 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 09:03:44,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:44,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:44,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:44,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:44,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:44,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:44,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:44,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39697,1696237348836': 2023-10-02 09:03:44,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-02 09:03:44,117 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-02 09:03:44,118 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:03:44,118 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:03:44,118 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,118 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:03:44,119 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,119 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,119 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:44,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:44,119 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,119 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:44,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:44,119 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:44,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:44,119 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:44,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:44,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:44,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,120 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:44,121 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,121 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:44,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:44,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:44,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,123 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,123 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:44,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:44,123 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:44,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:44,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:44,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:44,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:44,126 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,127 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:44,126 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:44,127 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,127 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:44,127 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:44,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:44,127 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,127 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:44,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:44,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-02 09:03:44,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,149 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696237424062Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696237424126 (+64 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696237424127 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696237424130 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696237424140 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696237424148 (+8 ms) 2023-10-02 09:03:44,151 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 09:03:44,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 86 msec 2023-10-02 09:03:44,167 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:44,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-02 09:03:44,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:03:44,168 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237424168 2023-10-02 09:03:44,168 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44077, tgtDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237424168, rawTgtDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237424168, srcFsUri=hdfs://localhost:44077, srcDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:03:44,191 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:03:44,191 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1582020438_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237424168, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237424168/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,191 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247, snapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-02 09:03:44,201 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237424168/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:44,222 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:44,223 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:44,223 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:44,224 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:44,872 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0004_000001 (auth:SIMPLE) 2023-10-02 09:03:45,105 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-6934891074249626116.jar 2023-10-02 09:03:45,105 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:45,106 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:45,173 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-5474370273194763105.jar 2023-10-02 09:03:45,174 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:45,174 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:45,174 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:45,175 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:45,175 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:45,175 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:45,176 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 09:03:45,176 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 09:03:45,176 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 09:03:45,177 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 09:03:45,177 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 09:03:45,178 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 09:03:45,178 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 09:03:45,178 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 09:03:45,178 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 09:03:45,179 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 09:03:45,179 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:45,180 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:45,180 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:45,181 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:45,181 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:45,181 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:45,182 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:45,530 WARN [Listener at jenkins-hbase4.apache.org/35395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 09:03:45,532 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-02 09:03:45,534 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-02 09:03:45,593 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:03:45,593 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:03:45,876 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0005_000001 (auth:SIMPLE) 2023-10-02 09:03:46,185 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 09:03:49,666 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0005_000001 (auth:SIMPLE) 2023-10-02 09:03:51,884 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0005_000001 (auth:SIMPLE) 2023-10-02 09:03:54,279 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0005_000001 (auth:SIMPLE) 2023-10-02 09:03:55,696 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 09:03:55,699 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 09:03:55,709 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:55,710 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 09:03:55,711 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 09:03:55,712 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:55,712 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-02 09:03:55,712 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-02 09:03:55,712 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237424168/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237424168/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:55,713 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237424168/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-02 09:03:55,713 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237424168/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-02 09:03:55,719 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:55,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:55,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:55,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 09:03:55,723 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237435723"}]},"ts":"1696237435723"} 2023-10-02 09:03:55,724 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-02 09:03:55,726 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-02 09:03:55,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae7e780d2959335660eaac9770fefa47, UNASSIGN}] 2023-10-02 09:03:55,728 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae7e780d2959335660eaac9770fefa47, UNASSIGN 2023-10-02 09:03:55,729 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ae7e780d2959335660eaac9770fefa47, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:55,729 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696237435729"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237435729"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237435729"}]},"ts":"1696237435729"} 2023-10-02 09:03:55,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure ae7e780d2959335660eaac9770fefa47, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:03:55,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 09:03:55,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:55,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ae7e780d2959335660eaac9770fefa47, disabling compactions & flushes 2023-10-02 09:03:55,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. 2023-10-02 09:03:55,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. 2023-10-02 09:03:55,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. after waiting 0 ms 2023-10-02 09:03:55,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. 2023-10-02 09:03:55,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-02 09:03:55,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:03:55,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47. 2023-10-02 09:03:55,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ae7e780d2959335660eaac9770fefa47: 2023-10-02 09:03:55,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:55,899 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ae7e780d2959335660eaac9770fefa47, regionState=CLOSED 2023-10-02 09:03:55,899 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696237435899"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237435899"}]},"ts":"1696237435899"} 2023-10-02 09:03:55,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-02 09:03:55,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure ae7e780d2959335660eaac9770fefa47, server=jenkins-hbase4.apache.org,39697,1696237348836 in 171 msec 2023-10-02 09:03:55,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-02 09:03:55,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae7e780d2959335660eaac9770fefa47, UNASSIGN in 176 msec 2023-10-02 09:03:55,904 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237435904"}]},"ts":"1696237435904"} 2023-10-02 09:03:55,905 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-02 09:03:55,907 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-02 09:03:55,908 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 188 msec 2023-10-02 09:03:56,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 09:03:56,025 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-02 09:03:56,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,029 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,030 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,031 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,034 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:56,034 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312 2023-10-02 09:03:56,034 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:56,035 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,035 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,035 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,035 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 09:03:56,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 09:03:56,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 09:03:56,036 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/recovered.edits] 2023-10-02 09:03:56,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 09:03:56,036 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/recovered.edits] 2023-10-02 09:03:56,036 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/recovered.edits] 2023-10-02 09:03:56,037 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,037 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,037 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,037 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:56,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:56,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-02 09:03:56,038 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,038 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,038 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,038 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:56,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:56,043 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/cf/2682bf17f6934495ada99101fc9ecf04 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/cf/2682bf17f6934495ada99101fc9ecf04 2023-10-02 09:03:56,043 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/cf/a65927db8bbe4b56be5b8e172fb0efb3 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/cf/a65927db8bbe4b56be5b8e172fb0efb3 2023-10-02 09:03:56,044 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf/2682bf17f6934495ada99101fc9ecf04.13e853a70524d86bf22be4ded57f4876 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf/2682bf17f6934495ada99101fc9ecf04.13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:56,046 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf/a65927db8bbe4b56be5b8e172fb0efb3.c9a30554609c235370e642a7f5074312 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/cf/a65927db8bbe4b56be5b8e172fb0efb3.c9a30554609c235370e642a7f5074312 2023-10-02 09:03:56,047 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/recovered.edits/8.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312/recovered.edits/8.seqid 2023-10-02 09:03:56,047 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/recovered.edits/8.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876/recovered.edits/8.seqid 2023-10-02 09:03:56,048 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c9a30554609c235370e642a7f5074312 2023-10-02 09:03:56,048 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/13e853a70524d86bf22be4ded57f4876 2023-10-02 09:03:56,049 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/recovered.edits/12.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47/recovered.edits/12.seqid 2023-10-02 09:03:56,049 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae7e780d2959335660eaac9770fefa47 2023-10-02 09:03:56,049 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-02 09:03:56,051 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,054 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-02 09:03:56,055 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-02 09:03:56,056 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,056 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-02 09:03:56,056 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237436056"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:56,058 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-02 09:03:56,058 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ae7e780d2959335660eaac9770fefa47, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696237422277.ae7e780d2959335660eaac9770fefa47.', STARTKEY => '', ENDKEY => ''}] 2023-10-02 09:03:56,058 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-02 09:03:56,058 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696237436058"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:56,059 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-02 09:03:56,061 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 35 msec 2023-10-02 09:03:56,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-02 09:03:56,139 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-02 09:03:56,140 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 09:03:56,144 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237436144"}]},"ts":"1696237436144"} 2023-10-02 09:03:56,146 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-02 09:03:56,147 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-02 09:03:56,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=81b3060fa0d636eacb54893618e5c399, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=058ea63a419721c267424486eb7cb94f, UNASSIGN}] 2023-10-02 09:03:56,150 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=81b3060fa0d636eacb54893618e5c399, UNASSIGN 2023-10-02 09:03:56,150 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=058ea63a419721c267424486eb7cb94f, UNASSIGN 2023-10-02 09:03:56,150 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=81b3060fa0d636eacb54893618e5c399, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:56,150 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=058ea63a419721c267424486eb7cb94f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:56,151 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696237436150"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237436150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237436150"}]},"ts":"1696237436150"} 2023-10-02 09:03:56,151 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696237436150"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237436150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237436150"}]},"ts":"1696237436150"} 2023-10-02 09:03:56,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 81b3060fa0d636eacb54893618e5c399, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:03:56,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 058ea63a419721c267424486eb7cb94f, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:03:56,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 09:03:56,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:56,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:56,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 058ea63a419721c267424486eb7cb94f, disabling compactions & flushes 2023-10-02 09:03:56,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 81b3060fa0d636eacb54893618e5c399, disabling compactions & flushes 2023-10-02 09:03:56,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:56,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:56,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:56,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:56,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. after waiting 0 ms 2023-10-02 09:03:56,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:56,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. after waiting 0 ms 2023-10-02 09:03:56,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:56,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:03:56,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:03:56,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:03:56,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:03:56,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f. 2023-10-02 09:03:56,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399. 2023-10-02 09:03:56,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 058ea63a419721c267424486eb7cb94f: 2023-10-02 09:03:56,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 81b3060fa0d636eacb54893618e5c399: 2023-10-02 09:03:56,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:56,322 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=81b3060fa0d636eacb54893618e5c399, regionState=CLOSED 2023-10-02 09:03:56,322 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696237436322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237436322"}]},"ts":"1696237436322"} 2023-10-02 09:03:56,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:56,323 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=058ea63a419721c267424486eb7cb94f, regionState=CLOSED 2023-10-02 09:03:56,323 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696237436322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237436322"}]},"ts":"1696237436322"} 2023-10-02 09:03:56,325 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-02 09:03:56,325 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 81b3060fa0d636eacb54893618e5c399, server=jenkins-hbase4.apache.org,40077,1696237348884 in 171 msec 2023-10-02 09:03:56,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-02 09:03:56,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 058ea63a419721c267424486eb7cb94f, server=jenkins-hbase4.apache.org,39697,1696237348836 in 171 msec 2023-10-02 09:03:56,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=81b3060fa0d636eacb54893618e5c399, UNASSIGN in 177 msec 2023-10-02 09:03:56,348 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-02 09:03:56,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=058ea63a419721c267424486eb7cb94f, UNASSIGN in 178 msec 2023-10-02 09:03:56,352 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237436352"}]},"ts":"1696237436352"} 2023-10-02 09:03:56,353 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-02 09:03:56,361 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-02 09:03:56,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 221 msec 2023-10-02 09:03:56,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 09:03:56,447 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-02 09:03:56,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,451 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,451 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,453 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,455 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:56,455 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,455 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,455 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,455 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:56,455 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 09:03:56,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 09:03:56,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 09:03:56,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 09:03:56,457 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,457 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,457 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,457 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,457 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,457 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,457 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,457 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,457 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/recovered.edits] 2023-10-02 09:03:56,458 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/recovered.edits] 2023-10-02 09:03:56,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-02 09:03:56,462 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/cf/e1a3a60188ad488c97d599fe6376f199 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/cf/e1a3a60188ad488c97d599fe6376f199 2023-10-02 09:03:56,462 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/cf/71a0111327ef4d60afd0c09a88775ac5 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/cf/71a0111327ef4d60afd0c09a88775ac5 2023-10-02 09:03:56,464 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399/recovered.edits/9.seqid 2023-10-02 09:03:56,464 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f/recovered.edits/9.seqid 2023-10-02 09:03:56,465 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/81b3060fa0d636eacb54893618e5c399 2023-10-02 09:03:56,465 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/058ea63a419721c267424486eb7cb94f 2023-10-02 09:03:56,465 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-02 09:03:56,465 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-02 09:03:56,466 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-02 09:03:56,469 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310027af427f001804aec90de59df4767901d to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310027af427f001804aec90de59df4767901d 2023-10-02 09:03:56,470 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310025c8e91728a0444279ae34af6eaf58222 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310025c8e91728a0444279ae34af6eaf58222 2023-10-02 09:03:56,470 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-02 09:03:56,472 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,474 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-02 09:03:56,476 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-02 09:03:56,477 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,477 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-02 09:03:56,477 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237436477"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:56,477 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237436477"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:56,478 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 09:03:56,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 81b3060fa0d636eacb54893618e5c399, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696237420910.81b3060fa0d636eacb54893618e5c399.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 058ea63a419721c267424486eb7cb94f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696237420910.058ea63a419721c267424486eb7cb94f.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 09:03:56,478 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-02 09:03:56,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696237436478"}]},"ts":"9223372036854775807"} 2023-10-02 09:03:56,480 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-02 09:03:56,482 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 34 msec 2023-10-02 09:03:56,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-02 09:03:56,560 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-02 09:03:56,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-02 09:03:56,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-02 09:03:56,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 09:03:56,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-02 09:03:56,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 09:03:56,600 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 747) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:50894 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:40611 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:50976 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2133700552_1 at /127.0.0.1:34150 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:51528 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2133700552_1 at /127.0.0.1:55280 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3957 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=236 (was 229) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=1248 (was 1297) 2023-10-02 09:03:56,601 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-02 09:03:56,621 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=236, ProcessCount=171, AvailableMemoryMB=1248 2023-10-02 09:03:56,621 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-02 09:03:56,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 09:03:56,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 09:03:56,626 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 09:03:56,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-02 09:03:56,627 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 09:03:56,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 09:03:56,629 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:03:56,629 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:03:56,630 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66 empty. 2023-10-02 09:03:56,630 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba empty. 2023-10-02 09:03:56,630 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:03:56,630 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:03:56,630 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-02 09:03:56,639 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-02 09:03:56,640 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6f8e8fd2ff4aa05ea40d4b7028cb93ba, NAME => 'testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:03:56,640 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 49145f56cf04aa66a5298cc37384ea66, NAME => 'testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:03:56,648 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:56,648 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 49145f56cf04aa66a5298cc37384ea66, disabling compactions & flushes 2023-10-02 09:03:56,648 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:56,648 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:56,648 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. after waiting 0 ms 2023-10-02 09:03:56,648 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:56,648 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:56,648 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 49145f56cf04aa66a5298cc37384ea66: 2023-10-02 09:03:56,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:56,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6f8e8fd2ff4aa05ea40d4b7028cb93ba, disabling compactions & flushes 2023-10-02 09:03:56,649 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:56,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:56,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. after waiting 0 ms 2023-10-02 09:03:56,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:56,649 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:56,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6f8e8fd2ff4aa05ea40d4b7028cb93ba: 2023-10-02 09:03:56,651 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 09:03:56,652 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696237436651"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237436651"}]},"ts":"1696237436651"} 2023-10-02 09:03:56,652 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696237436651"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237436651"}]},"ts":"1696237436651"} 2023-10-02 09:03:56,653 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 09:03:56,654 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 09:03:56,654 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237436654"}]},"ts":"1696237436654"} 2023-10-02 09:03:56,655 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-02 09:03:56,658 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 09:03:56,659 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 09:03:56,659 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 09:03:56,659 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 09:03:56,659 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 09:03:56,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=49145f56cf04aa66a5298cc37384ea66, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f8e8fd2ff4aa05ea40d4b7028cb93ba, ASSIGN}] 2023-10-02 09:03:56,662 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f8e8fd2ff4aa05ea40d4b7028cb93ba, ASSIGN 2023-10-02 09:03:56,662 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=49145f56cf04aa66a5298cc37384ea66, ASSIGN 2023-10-02 09:03:56,662 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f8e8fd2ff4aa05ea40d4b7028cb93ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40077,1696237348884; forceNewPlan=false, retain=false 2023-10-02 09:03:56,662 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=49145f56cf04aa66a5298cc37384ea66, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39697,1696237348836; forceNewPlan=false, retain=false 2023-10-02 09:03:56,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 09:03:56,813 INFO [jenkins-hbase4:39745] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 09:03:56,815 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=49145f56cf04aa66a5298cc37384ea66, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:56,815 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6f8e8fd2ff4aa05ea40d4b7028cb93ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:56,816 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696237436815"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237436815"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237436815"}]},"ts":"1696237436815"} 2023-10-02 09:03:56,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696237436815"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237436815"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237436815"}]},"ts":"1696237436815"} 2023-10-02 09:03:56,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 49145f56cf04aa66a5298cc37384ea66, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:03:56,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 6f8e8fd2ff4aa05ea40d4b7028cb93ba, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:03:56,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 09:03:56,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:56,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:56,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f8e8fd2ff4aa05ea40d4b7028cb93ba, NAME => 'testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 09:03:56,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 49145f56cf04aa66a5298cc37384ea66, NAME => 'testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 09:03:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. service=AccessControlService 2023-10-02 09:03:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. service=AccessControlService 2023-10-02 09:03:56,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:03:56,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:03:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:03:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:03:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:03:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:03:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:03:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:03:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:03:56,974 INFO [StoreOpener-49145f56cf04aa66a5298cc37384ea66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:03:56,974 INFO [StoreOpener-6f8e8fd2ff4aa05ea40d4b7028cb93ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:03:56,976 DEBUG [StoreOpener-49145f56cf04aa66a5298cc37384ea66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/cf 2023-10-02 09:03:56,976 DEBUG [StoreOpener-6f8e8fd2ff4aa05ea40d4b7028cb93ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/cf 2023-10-02 09:03:56,976 DEBUG [StoreOpener-49145f56cf04aa66a5298cc37384ea66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/cf 2023-10-02 09:03:56,976 DEBUG [StoreOpener-6f8e8fd2ff4aa05ea40d4b7028cb93ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/cf 2023-10-02 09:03:56,976 INFO [StoreOpener-49145f56cf04aa66a5298cc37384ea66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49145f56cf04aa66a5298cc37384ea66 columnFamilyName cf 2023-10-02 09:03:56,976 INFO [StoreOpener-6f8e8fd2ff4aa05ea40d4b7028cb93ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f8e8fd2ff4aa05ea40d4b7028cb93ba columnFamilyName cf 2023-10-02 09:03:56,978 INFO [StoreOpener-49145f56cf04aa66a5298cc37384ea66-1] regionserver.HStore(310): Store=49145f56cf04aa66a5298cc37384ea66/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:03:56,978 INFO [StoreOpener-6f8e8fd2ff4aa05ea40d4b7028cb93ba-1] regionserver.HStore(310): Store=6f8e8fd2ff4aa05ea40d4b7028cb93ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:03:56,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:03:56,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:03:56,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:03:56,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:03:56,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:03:56,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:03:56,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:03:56,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:03:56,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f8e8fd2ff4aa05ea40d4b7028cb93ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65515506, jitterRate=-0.023742884397506714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:03:56,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f8e8fd2ff4aa05ea40d4b7028cb93ba: 2023-10-02 09:03:56,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 49145f56cf04aa66a5298cc37384ea66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70372304, jitterRate=0.048629045486450195}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:03:56,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 49145f56cf04aa66a5298cc37384ea66: 2023-10-02 09:03:56,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66., pid=93, masterSystemTime=1696237436969 2023-10-02 09:03:56,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba., pid=94, masterSystemTime=1696237436969 2023-10-02 09:03:56,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:56,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:56,987 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6f8e8fd2ff4aa05ea40d4b7028cb93ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:56,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:56,987 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696237436987"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237436987"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237436987"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237436987"}]},"ts":"1696237436987"} 2023-10-02 09:03:56,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:56,987 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=49145f56cf04aa66a5298cc37384ea66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:56,988 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696237436987"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237436987"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237436987"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237436987"}]},"ts":"1696237436987"} 2023-10-02 09:03:56,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-10-02 09:03:56,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 6f8e8fd2ff4aa05ea40d4b7028cb93ba, server=jenkins-hbase4.apache.org,40077,1696237348884 in 170 msec 2023-10-02 09:03:56,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-02 09:03:56,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 49145f56cf04aa66a5298cc37384ea66, server=jenkins-hbase4.apache.org,39697,1696237348836 in 172 msec 2023-10-02 09:03:56,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f8e8fd2ff4aa05ea40d4b7028cb93ba, ASSIGN in 331 msec 2023-10-02 09:03:56,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-02 09:03:56,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=49145f56cf04aa66a5298cc37384ea66, ASSIGN in 332 msec 2023-10-02 09:03:56,993 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 09:03:56,993 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237436993"}]},"ts":"1696237436993"} 2023-10-02 09:03:56,994 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-02 09:03:56,996 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 09:03:56,996 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-02 09:03:56,997 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 09:03:56,999 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,999 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,999 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:56,999 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:03:57,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:57,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:57,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:57,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 09:03:57,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 378 msec 2023-10-02 09:03:57,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 09:03:57,231 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-02 09:03:57,233 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-02 09:03:57,233 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:57,235 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:03:57,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:03:57,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237437245 (current time:1696237437245). 2023-10-02 09:03:57,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:03:57,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x68bb7570 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:57,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65cb6dad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:57,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:57,258 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:57,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68bb7570 to 127.0.0.1:60549 2023-10-02 09:03:57,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:57,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x7cf7de3a to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:57,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f542421, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:57,268 DEBUG [hconnection-0x71cc8e63-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:57,270 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:57,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:57,276 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:57,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cf7de3a to 127.0.0.1:60549 2023-10-02 09:03:57,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:57,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 09:03:57,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:03:57,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:03:57,281 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:03:57,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:03:57,286 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:03:57,286 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696238037286 2023-10-02 09:03:57,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:03:57,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-02 09:03:57,288 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:03:57,288 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:03:57,289 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:03:57,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 09:03:57,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-02 09:03:57,293 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 09:03:57,293 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696238037293 2023-10-02 09:03:57,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,302 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-02 09:03:57,302 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:57,303 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-02 09:03:57,303 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-02 09:03:57,303 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,303 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,311 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,311 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,311 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,311 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,311 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,311 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,312 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,312 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:03:57,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 09:03:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 09:03:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 09:03:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,312 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 09:03:57,313 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 09:03:57,313 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 09:03:57,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,313 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 09:03:57,313 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 09:03:57,313 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:57,313 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 09:03:57,313 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:57,313 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:57,321 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 09:03:57,321 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 09:03:57,321 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 09:03:57,321 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 09:03:57,321 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 09:03:57,321 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 09:03:57,321 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 09:03:57,321 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 09:03:57,321 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 09:03:57,323 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,323 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,323 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:57,323 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,323 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,323 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:57,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:57,323 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:57,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:57,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:57,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 09:03:57,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2757e707[Count = 1] remaining members to acquire global barrier 2023-10-02 09:03:57,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:57,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:57,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:57,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:57,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:57,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 09:03:57,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2757e707[Count = 0] remaining members to acquire global barrier 2023-10-02 09:03:57,327 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 09:03:57,327 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,329 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,329 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,329 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,329 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,329 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:03:57,329 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:03:57,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,329 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 09:03:57,329 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:03:57,329 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:57,329 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:57,329 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:03:57,329 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:57,329 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:57,330 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:57,330 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:57,329 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. started... 2023-10-02 09:03:57,329 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,330 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:03:57,330 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. started... 2023-10-02 09:03:57,330 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 49145f56cf04aa66a5298cc37384ea66: 2023-10-02 09:03:57,331 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f8e8fd2ff4aa05ea40d4b7028cb93ba: 2023-10-02 09:03:57,331 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,332 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:57,332 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,332 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:03:57,332 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:57,332 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:03:57,333 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 09:03:57,333 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:57,333 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 09:03:57,349 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. completed. 2023-10-02 09:03:57,349 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:57,349 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:57,349 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:57,349 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,349 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 09:03:57,349 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:03:57,351 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 09:03:57,351 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:57,351 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 09:03:57,353 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:57,353 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. completed. 2023-10-02 09:03:57,353 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:57,353 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 09:03:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:03:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:57,355 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,355 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 09:03:57,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,355 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:57,355 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 09:03:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39697,1696237348836': 2023-10-02 09:03:57,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 09:03:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40077,1696237348884': 2023-10-02 09:03:57,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 09:03:57,363 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-02 09:03:57,363 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:03:57,363 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:03:57,363 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,364 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:03:57,365 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,365 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:57,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:57,365 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,365 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,365 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,365 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,365 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,366 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,366 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,367 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:57,368 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,368 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,369 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,375 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,375 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,375 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,375 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,375 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,375 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,375 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:57,375 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,375 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,375 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-02 09:03:57,377 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,377 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:03:57,376 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,377 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,377 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,377 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,377 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,377 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 09:03:57,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,388 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:57,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 09:03:57,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:03:57,389 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:03:57,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,407 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-02 09:03:57,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,407 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696237437287Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696237437384 (+97 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696237437384Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696237437384Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696237437387 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696237437400 (+13 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696237437407 (+7 ms) 2023-10-02 09:03:57,411 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 09:03:57,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 123 msec 2023-10-02 09:03:57,589 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:57,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 09:03:57,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:03:57,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39697] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:03:57,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40077] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:03:57,597 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-02 09:03:57,597 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:57,597 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:03:57,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:03:57,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237437606 (current time:1696237437606). 2023-10-02 09:03:57,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:03:57,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x2ce6857a to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:57,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@408be1ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:57,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:57,619 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:57,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ce6857a to 127.0.0.1:60549 2023-10-02 09:03:57,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:57,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x041d77b4 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:03:57,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c48ef18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:03:57,627 DEBUG [hconnection-0x3d36177-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:57,628 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:57,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:03:57,633 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:03:57,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x041d77b4 to 127.0.0.1:60549 2023-10-02 09:03:57,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:03:57,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 09:03:57,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:03:57,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:03:57,637 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:03:57,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:03:57,639 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:03:57,640 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696238037640 2023-10-02 09:03:57,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 09:03:57,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-02 09:03:57,641 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:03:57,641 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:03:57,644 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 09:03:57,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 09:03:57,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-02 09:03:57,646 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 09:03:57,647 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696238037647 2023-10-02 09:03:57,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,655 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-02 09:03:57,655 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:57,657 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-02 09:03:57,657 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-02 09:03:57,657 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,657 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,658 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,658 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,658 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,658 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,659 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,659 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,659 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,659 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:03:57,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,660 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 09:03:57,660 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:57,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,661 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 09:03:57,661 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 09:03:57,662 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:57,661 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 09:03:57,662 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 09:03:57,661 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 09:03:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 09:03:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:03:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 09:03:57,666 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 09:03:57,666 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 09:03:57,666 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 09:03:57,666 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 09:03:57,667 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,667 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:57,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:57,668 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,668 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,668 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,668 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:03:57,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:57,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 09:03:57,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@658ca244[Count = 1] remaining members to acquire global barrier 2023-10-02 09:03:57,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:57,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:57,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:57,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:57,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:57,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 09:03:57,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@658ca244[Count = 0] remaining members to acquire global barrier 2023-10-02 09:03:57,678 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 09:03:57,678 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,683 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,683 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,683 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,683 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,683 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:03:57,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,683 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 09:03:57,683 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:03:57,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,683 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,683 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:03:57,683 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 09:03:57,683 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:03:57,683 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:57,683 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:57,683 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:03:57,684 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:03:57,683 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:57,684 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:57,684 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. started... 2023-10-02 09:03:57,684 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. started... 2023-10-02 09:03:57,684 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 49145f56cf04aa66a5298cc37384ea66 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-02 09:03:57,684 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6f8e8fd2ff4aa05ea40d4b7028cb93ba 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-02 09:03:57,687 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 09:03:57,687 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:57,687 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 09:03:57,701 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231002a9a1eebeba90408e8b186aa73e080fc0 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231002a9a1eebeba90408e8b186aa73e080fc0 2023-10-02 09:03:57,701 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002647df2ed3fed4549890b68ae5bbfe6db to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002647df2ed3fed4549890b68ae5bbfe6db 2023-10-02 09:03:57,708 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/.tmp/cf/8957d66795a1428581fb182a927a6346 2023-10-02 09:03:57,708 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/.tmp/cf/b9400d0f16264ca0a38b3ee8f5422bd0 2023-10-02 09:03:57,713 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/.tmp/cf/8957d66795a1428581fb182a927a6346 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/cf/8957d66795a1428581fb182a927a6346 2023-10-02 09:03:57,713 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/.tmp/cf/b9400d0f16264ca0a38b3ee8f5422bd0 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/cf/b9400d0f16264ca0a38b3ee8f5422bd0 2023-10-02 09:03:57,718 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/cf/8957d66795a1428581fb182a927a6346, entries=45, sequenceid=6, filesize=12.7 K 2023-10-02 09:03:57,718 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/cf/b9400d0f16264ca0a38b3ee8f5422bd0, entries=5, sequenceid=6, filesize=5.8 K 2023-10-02 09:03:57,719 INFO [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 49145f56cf04aa66a5298cc37384ea66 in 35ms, sequenceid=6, compaction requested=false 2023-10-02 09:03:57,719 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 6f8e8fd2ff4aa05ea40d4b7028cb93ba in 35ms, sequenceid=6, compaction requested=false 2023-10-02 09:03:57,719 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-02 09:03:57,719 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-02 09:03:57,724 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 49145f56cf04aa66a5298cc37384ea66: 2023-10-02 09:03:57,724 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f8e8fd2ff4aa05ea40d4b7028cb93ba: 2023-10-02 09:03:57,724 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,724 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,724 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:57,724 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:03:57,724 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/cf/b9400d0f16264ca0a38b3ee8f5422bd0] hfiles 2023-10-02 09:03:57,724 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/cf/8957d66795a1428581fb182a927a6346] hfiles 2023-10-02 09:03:57,724 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/cf/b9400d0f16264ca0a38b3ee8f5422bd0 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,724 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/cf/8957d66795a1428581fb182a927a6346 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,734 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. completed. 2023-10-02 09:03:57,734 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:03:57,734 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. completed. 2023-10-02 09:03:57,734 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,735 DEBUG [rs(jenkins-hbase4.apache.org,39697,1696237348836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:03:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 09:03:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:03:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:03:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:03:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 09:03:57,735 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:03:57,737 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,737 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 09:03:57,737 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,737 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:57,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:57,737 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 09:03:57,737 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 09:03:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:57,739 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 09:03:57,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,742 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:57,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 09:03:57,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:03:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,743 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:03:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40077,1696237348884': 2023-10-02 09:03:57,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 09:03:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39697,1696237348836': 2023-10-02 09:03:57,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 09:03:57,747 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-02 09:03:57,748 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:03:57,748 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:03:57,748 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,748 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:03:57,749 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,749 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:03:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:03:57,749 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,749 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,750 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:03:57,750 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,749 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,750 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,752 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:03:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,752 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:03:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,754 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,754 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,754 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,757 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,757 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,757 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,757 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,757 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,757 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:03:57,757 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:03:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:03:57,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,757 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:03:57,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-02 09:03:57,757 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,757 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,757 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:03:57,759 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:03:57,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,759 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:03:57,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:03:57,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:03:57,759 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,759 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:03:57,759 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:03:57,759 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,759 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002647df2ed3fed4549890b68ae5bbfe6db, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231002a9a1eebeba90408e8b186aa73e080fc0] mob files 2023-10-02 09:03:57,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002647df2ed3fed4549890b68ae5bbfe6db 2023-10-02 09:03:57,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231002a9a1eebeba90408e8b186aa73e080fc0 2023-10-02 09:03:57,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,793 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-02 09:03:57,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,793 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696237437640Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696237437767 (+127 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696237437767Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696237437767Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696237437776 (+9 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696237437786 (+10 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696237437793 (+7 ms) 2023-10-02 09:03:57,796 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 09:03:57,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 155 msec 2023-10-02 09:03:57,943 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:03:57,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 09:03:57,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:03:57,944 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237437944 2023-10-02 09:03:57,944 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44077, tgtDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237437944, rawTgtDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237437944, srcFsUri=hdfs://localhost:44077, srcDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:03:57,967 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:03:57,967 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-64686756_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237437944, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237437944/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,967 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247, snapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-02 09:03:57,972 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237437944/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:03:57,995 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:57,995 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:57,996 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:57,996 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:58,872 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-1906271586148982543.jar 2023-10-02 09:03:58,873 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:58,873 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:58,940 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-8859805111148978249.jar 2023-10-02 09:03:58,940 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:58,940 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:58,941 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:58,941 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:58,941 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:58,942 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 09:03:58,942 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 09:03:58,942 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 09:03:58,943 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 09:03:58,943 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 09:03:58,943 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 09:03:58,944 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 09:03:58,944 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 09:03:58,944 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 09:03:58,945 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 09:03:58,945 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 09:03:58,946 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:58,946 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:58,947 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:58,947 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:58,947 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:03:58,948 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:58,948 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:03:59,297 WARN [Listener at jenkins-hbase4.apache.org/35395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 09:03:59,300 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-02 09:04:00,451 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:04:00,451 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:04:00,454 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0005_000001 (auth:SIMPLE) 2023-10-02 09:04:00,918 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0006_000001 (auth:SIMPLE) 2023-10-02 09:04:01,491 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 09:04:04,764 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0006_000001 (auth:SIMPLE) 2023-10-02 09:04:07,634 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 09:04:07,635 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 09:04:07,640 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:04:07,640 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 09:04:07,641 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 09:04:07,641 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:04:07,641 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-02 09:04:07,641 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-02 09:04:07,642 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237437944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237437944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:04:07,642 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237437944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-02 09:04:07,642 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237437944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-02 09:04:07,646 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 09:04:07,651 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237447651"}]},"ts":"1696237447651"} 2023-10-02 09:04:07,652 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-02 09:04:07,653 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-02 09:04:07,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=49145f56cf04aa66a5298cc37384ea66, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f8e8fd2ff4aa05ea40d4b7028cb93ba, UNASSIGN}] 2023-10-02 09:04:07,656 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f8e8fd2ff4aa05ea40d4b7028cb93ba, UNASSIGN 2023-10-02 09:04:07,656 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=49145f56cf04aa66a5298cc37384ea66, UNASSIGN 2023-10-02 09:04:07,657 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6f8e8fd2ff4aa05ea40d4b7028cb93ba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:07,657 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=49145f56cf04aa66a5298cc37384ea66, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:07,657 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696237447657"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237447657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237447657"}]},"ts":"1696237447657"} 2023-10-02 09:04:07,657 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696237447657"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237447657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237447657"}]},"ts":"1696237447657"} 2023-10-02 09:04:07,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 6f8e8fd2ff4aa05ea40d4b7028cb93ba, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:04:07,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 49145f56cf04aa66a5298cc37384ea66, server=jenkins-hbase4.apache.org,39697,1696237348836}] 2023-10-02 09:04:07,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 09:04:07,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:04:07,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f8e8fd2ff4aa05ea40d4b7028cb93ba, disabling compactions & flushes 2023-10-02 09:04:07,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:04:07,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:04:07,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. after waiting 0 ms 2023-10-02 09:04:07,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:04:07,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:04:07,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 49145f56cf04aa66a5298cc37384ea66, disabling compactions & flushes 2023-10-02 09:04:07,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:04:07,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:04:07,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. after waiting 0 ms 2023-10-02 09:04:07,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:04:07,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:04:07,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:04:07,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:07,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba. 2023-10-02 09:04:07,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f8e8fd2ff4aa05ea40d4b7028cb93ba: 2023-10-02 09:04:07,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:07,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66. 2023-10-02 09:04:07,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 49145f56cf04aa66a5298cc37384ea66: 2023-10-02 09:04:07,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:04:07,824 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6f8e8fd2ff4aa05ea40d4b7028cb93ba, regionState=CLOSED 2023-10-02 09:04:07,824 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696237447824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237447824"}]},"ts":"1696237447824"} 2023-10-02 09:04:07,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:04:07,824 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=49145f56cf04aa66a5298cc37384ea66, regionState=CLOSED 2023-10-02 09:04:07,824 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696237447824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237447824"}]},"ts":"1696237447824"} 2023-10-02 09:04:07,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-10-02 09:04:07,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 6f8e8fd2ff4aa05ea40d4b7028cb93ba, server=jenkins-hbase4.apache.org,40077,1696237348884 in 167 msec 2023-10-02 09:04:07,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-10-02 09:04:07,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 49145f56cf04aa66a5298cc37384ea66, server=jenkins-hbase4.apache.org,39697,1696237348836 in 167 msec 2023-10-02 09:04:07,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f8e8fd2ff4aa05ea40d4b7028cb93ba, UNASSIGN in 173 msec 2023-10-02 09:04:07,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-10-02 09:04:07,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=49145f56cf04aa66a5298cc37384ea66, UNASSIGN in 173 msec 2023-10-02 09:04:07,829 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237447829"}]},"ts":"1696237447829"} 2023-10-02 09:04:07,830 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-02 09:04:07,832 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-02 09:04:07,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 185 msec 2023-10-02 09:04:07,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 09:04:07,953 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-02 09:04:07,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,957 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,958 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,960 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,962 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:04:07,962 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:04:07,963 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,963 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,963 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,963 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 09:04:07,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 09:04:07,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 09:04:07,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 09:04:07,964 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,964 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,964 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,965 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:07,965 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,965 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:07,965 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:07,965 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/recovered.edits] 2023-10-02 09:04:07,965 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/recovered.edits] 2023-10-02 09:04:07,965 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:07,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-02 09:04:07,969 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/cf/8957d66795a1428581fb182a927a6346 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/cf/8957d66795a1428581fb182a927a6346 2023-10-02 09:04:07,969 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/cf/b9400d0f16264ca0a38b3ee8f5422bd0 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/cf/b9400d0f16264ca0a38b3ee8f5422bd0 2023-10-02 09:04:07,971 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba/recovered.edits/9.seqid 2023-10-02 09:04:07,971 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66/recovered.edits/9.seqid 2023-10-02 09:04:07,972 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f8e8fd2ff4aa05ea40d4b7028cb93ba 2023-10-02 09:04:07,972 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testEmptyExportFileSystemState/49145f56cf04aa66a5298cc37384ea66 2023-10-02 09:04:07,972 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-02 09:04:07,972 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-02 09:04:07,973 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-02 09:04:07,976 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002647df2ed3fed4549890b68ae5bbfe6db to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002647df2ed3fed4549890b68ae5bbfe6db 2023-10-02 09:04:07,977 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231002a9a1eebeba90408e8b186aa73e080fc0 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231002a9a1eebeba90408e8b186aa73e080fc0 2023-10-02 09:04:07,977 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-02 09:04:07,979 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,981 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-02 09:04:07,983 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-02 09:04:07,984 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,984 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-02 09:04:07,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237447984"}]},"ts":"9223372036854775807"} 2023-10-02 09:04:07,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237447984"}]},"ts":"9223372036854775807"} 2023-10-02 09:04:07,985 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 09:04:07,986 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 49145f56cf04aa66a5298cc37384ea66, NAME => 'testtb-testEmptyExportFileSystemState,,1696237436622.49145f56cf04aa66a5298cc37384ea66.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6f8e8fd2ff4aa05ea40d4b7028cb93ba, NAME => 'testtb-testEmptyExportFileSystemState,1,1696237436622.6f8e8fd2ff4aa05ea40d4b7028cb93ba.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 09:04:07,986 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-02 09:04:07,986 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696237447986"}]},"ts":"9223372036854775807"} 2023-10-02 09:04:07,987 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-02 09:04:07,988 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 09:04:07,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 35 msec 2023-10-02 09:04:08,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-02 09:04:08,067 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-02 09:04:08,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-02 09:04:08,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 09:04:08,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-02 09:04:08,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-02 09:04:08,101 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 758) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1113098203_1 at /127.0.0.1:39462 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:46095 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4613 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1113098203_1 at /127.0.0.1:51964 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:39468 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1851388388_17 at /127.0.0.1:54204 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:38073 from appattempt_1696237355285_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0xe119ed6-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1781244183) connection to jenkins-hbase4.apache.org/172.31.14.131:46571 from appattempt_1696237355285_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-592847755_17 at /127.0.0.1:49570 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 236), ProcessCount=171 (was 171), AvailableMemoryMB=1231 (was 1248) 2023-10-02 09:04:08,102 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-02 09:04:08,121 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=171, AvailableMemoryMB=1231 2023-10-02 09:04:08,121 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-02 09:04:08,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 09:04:08,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,126 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 09:04:08,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-02 09:04:08,127 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 09:04:08,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 09:04:08,129 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:08,129 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:08,129 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950 empty. 2023-10-02 09:04:08,129 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc empty. 2023-10-02 09:04:08,130 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:08,130 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:08,130 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-02 09:04:08,139 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-02 09:04:08,140 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9b9981c7b2f70cb0c2a19d2ca504fdfc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:04:08,140 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => d322e70296c63ab26eb9f71bef1bf950, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp 2023-10-02 09:04:08,156 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:04:08,156 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:04:08,156 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing d322e70296c63ab26eb9f71bef1bf950, disabling compactions & flushes 2023-10-02 09:04:08,156 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 9b9981c7b2f70cb0c2a19d2ca504fdfc, disabling compactions & flushes 2023-10-02 09:04:08,156 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:08,156 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:08,156 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:08,156 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. after waiting 0 ms 2023-10-02 09:04:08,156 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:08,156 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:08,156 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:08,156 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. after waiting 0 ms 2023-10-02 09:04:08,156 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for d322e70296c63ab26eb9f71bef1bf950: 2023-10-02 09:04:08,157 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:08,157 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:08,157 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 9b9981c7b2f70cb0c2a19d2ca504fdfc: 2023-10-02 09:04:08,159 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 09:04:08,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696237448159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237448159"}]},"ts":"1696237448159"} 2023-10-02 09:04:08,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696237448159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237448159"}]},"ts":"1696237448159"} 2023-10-02 09:04:08,162 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 09:04:08,162 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 09:04:08,162 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237448162"}]},"ts":"1696237448162"} 2023-10-02 09:04:08,163 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-02 09:04:08,167 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 09:04:08,168 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 09:04:08,168 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 09:04:08,168 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 09:04:08,168 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 09:04:08,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d322e70296c63ab26eb9f71bef1bf950, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b9981c7b2f70cb0c2a19d2ca504fdfc, ASSIGN}] 2023-10-02 09:04:08,171 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b9981c7b2f70cb0c2a19d2ca504fdfc, ASSIGN 2023-10-02 09:04:08,171 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d322e70296c63ab26eb9f71bef1bf950, ASSIGN 2023-10-02 09:04:08,171 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b9981c7b2f70cb0c2a19d2ca504fdfc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44871,1696237348922; forceNewPlan=false, retain=false 2023-10-02 09:04:08,171 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d322e70296c63ab26eb9f71bef1bf950, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40077,1696237348884; forceNewPlan=false, retain=false 2023-10-02 09:04:08,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 09:04:08,322 INFO [jenkins-hbase4:39745] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 09:04:08,324 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d322e70296c63ab26eb9f71bef1bf950, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,324 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9b9981c7b2f70cb0c2a19d2ca504fdfc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,325 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696237448324"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237448324"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237448324"}]},"ts":"1696237448324"} 2023-10-02 09:04:08,325 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696237448324"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237448324"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237448324"}]},"ts":"1696237448324"} 2023-10-02 09:04:08,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure d322e70296c63ab26eb9f71bef1bf950, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:04:08,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 9b9981c7b2f70cb0c2a19d2ca504fdfc, server=jenkins-hbase4.apache.org,44871,1696237348922}] 2023-10-02 09:04:08,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 09:04:08,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:08,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:08,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b9981c7b2f70cb0c2a19d2ca504fdfc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 09:04:08,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d322e70296c63ab26eb9f71bef1bf950, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 09:04:08,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. service=AccessControlService 2023-10-02 09:04:08,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. service=AccessControlService 2023-10-02 09:04:08,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:04:08,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 09:04:08,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:08,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:08,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:04:08,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 09:04:08,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:08,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:08,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:08,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:08,484 INFO [StoreOpener-d322e70296c63ab26eb9f71bef1bf950-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:08,484 INFO [StoreOpener-9b9981c7b2f70cb0c2a19d2ca504fdfc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:08,486 DEBUG [StoreOpener-d322e70296c63ab26eb9f71bef1bf950-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/cf 2023-10-02 09:04:08,486 DEBUG [StoreOpener-d322e70296c63ab26eb9f71bef1bf950-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/cf 2023-10-02 09:04:08,486 DEBUG [StoreOpener-9b9981c7b2f70cb0c2a19d2ca504fdfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/cf 2023-10-02 09:04:08,486 DEBUG [StoreOpener-9b9981c7b2f70cb0c2a19d2ca504fdfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/cf 2023-10-02 09:04:08,486 INFO [StoreOpener-d322e70296c63ab26eb9f71bef1bf950-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d322e70296c63ab26eb9f71bef1bf950 columnFamilyName cf 2023-10-02 09:04:08,486 INFO [StoreOpener-9b9981c7b2f70cb0c2a19d2ca504fdfc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b9981c7b2f70cb0c2a19d2ca504fdfc columnFamilyName cf 2023-10-02 09:04:08,487 INFO [StoreOpener-d322e70296c63ab26eb9f71bef1bf950-1] regionserver.HStore(310): Store=d322e70296c63ab26eb9f71bef1bf950/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:04:08,487 INFO [StoreOpener-9b9981c7b2f70cb0c2a19d2ca504fdfc-1] regionserver.HStore(310): Store=9b9981c7b2f70cb0c2a19d2ca504fdfc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 09:04:08,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:08,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:08,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:08,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:08,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:08,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:08,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:04:08,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 09:04:08,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d322e70296c63ab26eb9f71bef1bf950; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74974786, jitterRate=0.11721137166023254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:04:08,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d322e70296c63ab26eb9f71bef1bf950: 2023-10-02 09:04:08,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9b9981c7b2f70cb0c2a19d2ca504fdfc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63990146, jitterRate=-0.046472519636154175}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 09:04:08,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9b9981c7b2f70cb0c2a19d2ca504fdfc: 2023-10-02 09:04:08,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950., pid=108, masterSystemTime=1696237448478 2023-10-02 09:04:08,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc., pid=109, masterSystemTime=1696237448478 2023-10-02 09:04:08,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:08,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:08,496 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d322e70296c63ab26eb9f71bef1bf950, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:08,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:08,496 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696237448496"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237448496"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237448496"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237448496"}]},"ts":"1696237448496"} 2023-10-02 09:04:08,497 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9b9981c7b2f70cb0c2a19d2ca504fdfc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,497 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696237448497"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696237448497"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696237448497"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696237448497"}]},"ts":"1696237448497"} 2023-10-02 09:04:08,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-02 09:04:08,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure d322e70296c63ab26eb9f71bef1bf950, server=jenkins-hbase4.apache.org,40077,1696237348884 in 172 msec 2023-10-02 09:04:08,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-02 09:04:08,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 9b9981c7b2f70cb0c2a19d2ca504fdfc, server=jenkins-hbase4.apache.org,44871,1696237348922 in 171 msec 2023-10-02 09:04:08,500 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d322e70296c63ab26eb9f71bef1bf950, ASSIGN in 331 msec 2023-10-02 09:04:08,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-02 09:04:08,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b9981c7b2f70cb0c2a19d2ca504fdfc, ASSIGN in 332 msec 2023-10-02 09:04:08,501 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 09:04:08,502 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237448502"}]},"ts":"1696237448502"} 2023-10-02 09:04:08,503 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-02 09:04:08,505 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 09:04:08,505 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-02 09:04:08,506 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 09:04:08,508 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:08,508 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:08,508 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:08,508 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:08,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 09:04:08,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 09:04:08,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 09:04:08,510 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 09:04:08,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 386 msec 2023-10-02 09:04:08,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 09:04:08,731 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-02 09:04:08,733 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,733 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:08,735 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:04:08,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 09:04:08,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237448747 (current time:1696237448747). 2023-10-02 09:04:08,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:04:08,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x7e945a75 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:04:08,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@594f0334, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:04:08,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:04:08,758 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:04:08,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e945a75 to 127.0.0.1:60549 2023-10-02 09:04:08,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:08,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x3a19d902 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:04:08,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66826bc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:04:08,767 DEBUG [hconnection-0x47758281-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:04:08,769 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:04:08,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:04:08,775 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:04:08,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a19d902 to 127.0.0.1:60549 2023-10-02 09:04:08,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:08,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 09:04:08,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:04:08,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 09:04:08,779 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:04:08,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 09:04:08,781 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 09:04:08,781 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696238048781 2023-10-02 09:04:08,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 09:04:08,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,783 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:04:08,783 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:04:08,784 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 09:04:08,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 09:04:08,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-02 09:04:08,785 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 09:04:08,786 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696238048786 2023-10-02 09:04:08,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,800 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-02 09:04:08,800 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:04:08,802 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-02 09:04:08,802 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-02 09:04:08,802 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,802 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,805 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:08,805 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:08,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:08,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:08,805 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,805 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:08,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,805 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,805 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,806 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,806 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 09:04:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,807 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 09:04:08,807 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 09:04:08,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,807 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 09:04:08,807 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 09:04:08,807 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:04:08,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,808 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 09:04:08,808 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 09:04:08,807 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:04:08,808 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:04:08,808 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 09:04:08,810 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 09:04:08,810 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 09:04:08,809 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 09:04:08,810 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 09:04:08,810 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 09:04:08,810 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 09:04:08,810 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 09:04:08,816 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,816 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:04:08,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:04:08,817 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:04:08,817 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,817 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,817 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,817 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:04:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:04:08,817 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,817 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,817 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:04:08,817 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:04:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:04:08,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 09:04:08,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4beb5b97[Count = 1] remaining members to acquire global barrier 2023-10-02 09:04:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:04:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:04:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:04:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:04:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:04:08,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 09:04:08,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4beb5b97[Count = 0] remaining members to acquire global barrier 2023-10-02 09:04:08,820 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-02 09:04:08,821 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,821 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,822 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,821 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 09:04:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 09:04:08,822 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 09:04:08,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:04:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:04:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:04:08,822 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,822 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. started... 2023-10-02 09:04:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 09:04:08,822 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,824 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:04:08,824 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b9981c7b2f70cb0c2a19d2ca504fdfc: 2023-10-02 09:04:08,824 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:04:08,824 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:08,824 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:04:08,824 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,824 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. started... 2023-10-02 09:04:08,824 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:04:08,824 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:04:08,824 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d322e70296c63ab26eb9f71bef1bf950: 2023-10-02 09:04:08,824 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,824 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:04:08,825 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 09:04:08,826 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 09:04:08,826 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:04:08,826 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 09:04:08,840 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. completed. 2023-10-02 09:04:08,840 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:04:08,840 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. completed. 2023-10-02 09:04:08,840 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:04:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:04:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:04:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 09:04:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 09:04:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:04:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:04:08,842 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,842 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 09:04:08,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:04:08,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:04:08,842 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:04:08,842 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 09:04:08,844 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 09:04:08,844 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:04:08,844 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:04:08,844 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 09:04:08,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:04:08,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:04:08,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44871,1696237348922': 2023-10-02 09:04:08,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-02 09:04:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:04:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:04:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:04:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:04:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:04:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40077,1696237348884': 2023-10-02 09:04:08,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-02 09:04:08,851 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-02 09:04:08,851 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:04:08,851 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:04:08,851 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,851 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:04:08,853 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,853 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:04:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:04:08,853 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,853 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:08,853 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,853 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:08,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,853 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:04:08,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,854 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:08,854 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:04:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,855 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:04:08,856 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,856 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,857 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,860 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,860 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:08,860 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,860 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:08,860 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:08,860 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:08,860 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:08,860 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:08,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:08,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:08,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:08,860 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:08,860 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,861 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,861 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:08,861 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,860 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:04:08,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:08,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:08,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:08,862 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:08,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,862 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:08,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:04:08,864 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:08,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:08,864 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,864 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:08,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 09:04:08,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,883 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:04:08,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 09:04:08,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:04:08,884 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:04:08,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-02 09:04:08,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,898 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:08,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696237448782Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696237448875 (+93 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696237448875Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696237448876 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696237448879 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696237448888 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696237448897 (+9 ms) 2023-10-02 09:04:08,901 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 09:04:08,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 119 msec 2023-10-02 09:04:09,084 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:04:09,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 09:04:09,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:04:09,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40077] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:04:09,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44871] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 09:04:09,091 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,091 DEBUG [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:09,091 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 09:04:09,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 09:04:09,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696237449099 (current time:1696237449099). 2023-10-02 09:04:09,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 09:04:09,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x5eb6ddc5 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:04:09,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e6797c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:04:09,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:04:09,108 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:04:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5eb6ddc5 to 127.0.0.1:60549 2023-10-02 09:04:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:09,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(139): Connect 0x62603dc6 to 127.0.0.1:60549 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 09:04:09,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ad08cba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 09:04:09,117 DEBUG [hconnection-0x686bc3b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:04:09,120 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:04:09,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 09:04:09,131 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 09:04:09,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62603dc6 to 127.0.0.1:60549 2023-10-02 09:04:09,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:09,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 09:04:09,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 09:04:09,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 09:04:09,136 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot, current working dir path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 09:04:09,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 09:04:09,139 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 09:04:09,140 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696238049140 2023-10-02 09:04:09,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 09:04:09,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,141 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 09:04:09,141 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 09:04:09,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 09:04:09,142 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 09:04:09,143 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-02 09:04:09,144 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 09:04:09,145 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696238049145 2023-10-02 09:04:09,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,158 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-02 09:04:09,158 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:04:09,160 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-02 09:04:09,160 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-02 09:04:09,161 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,161 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,162 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:09,162 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,162 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:09,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:09,162 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:09,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:09,163 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:09,163 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,164 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,164 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 09:04:09,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 09:04:09,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,165 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 09:04:09,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 09:04:09,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,165 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 09:04:09,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 09:04:09,165 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 09:04:09,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,166 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:04:09,166 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 09:04:09,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 09:04:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 09:04:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 09:04:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 09:04:09,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:04:09,170 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 09:04:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 09:04:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 09:04:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 09:04:09,172 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 09:04:09,173 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 09:04:09,173 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 09:04:09,173 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39697,1696237348836' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 09:04:09,174 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,174 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:04:09,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:04:09,175 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:04:09,175 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,175 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,175 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,175 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:04:09,176 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,176 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:04:09,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:04:09,176 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,176 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 09:04:09,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:04:09,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40077,1696237348884' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 09:04:09,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c8aecf7[Count = 1] remaining members to acquire global barrier 2023-10-02 09:04:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:04:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:04:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:04:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:04:09,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:04:09,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44871,1696237348922' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 09:04:09,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c8aecf7[Count = 0] remaining members to acquire global barrier 2023-10-02 09:04:09,180 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-02 09:04:09,180 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,185 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,185 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,185 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,185 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,185 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 09:04:09,185 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 09:04:09,186 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,186 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 09:04:09,185 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 09:04:09,186 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:04:09,186 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:04:09,186 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:09,186 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 09:04:09,186 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:09,186 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. started... 2023-10-02 09:04:09,186 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. started... 2023-10-02 09:04:09,186 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 09:04:09,186 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39697,1696237348836' in zk 2023-10-02 09:04:09,186 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d322e70296c63ab26eb9f71bef1bf950 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-02 09:04:09,186 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 09:04:09,186 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9b9981c7b2f70cb0c2a19d2ca504fdfc 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-02 09:04:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 09:04:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:04:09,188 DEBUG [member: 'jenkins-hbase4.apache.org,39697,1696237348836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 09:04:09,214 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231002b70b4514b1d14a4ea0e08b23b4a705ea to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002b70b4514b1d14a4ea0e08b23b4a705ea 2023-10-02 09:04:09,214 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002b381e96ba7954702b8e7e971e9f10317 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231002b381e96ba7954702b8e7e971e9f10317 2023-10-02 09:04:09,225 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/.tmp/cf/2507fd5daf564283a090a6b1f3772ae8 2023-10-02 09:04:09,225 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/.tmp/cf/413ad490a74c4bc8bf9e38f5a1f7919e 2023-10-02 09:04:09,230 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/.tmp/cf/2507fd5daf564283a090a6b1f3772ae8 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/cf/2507fd5daf564283a090a6b1f3772ae8 2023-10-02 09:04:09,230 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/.tmp/cf/413ad490a74c4bc8bf9e38f5a1f7919e as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/cf/413ad490a74c4bc8bf9e38f5a1f7919e 2023-10-02 09:04:09,234 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/cf/2507fd5daf564283a090a6b1f3772ae8, entries=3, sequenceid=6, filesize=5.4 K 2023-10-02 09:04:09,235 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/cf/413ad490a74c4bc8bf9e38f5a1f7919e, entries=47, sequenceid=6, filesize=13.4 K 2023-10-02 09:04:09,235 INFO [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for d322e70296c63ab26eb9f71bef1bf950 in 49ms, sequenceid=6, compaction requested=false 2023-10-02 09:04:09,235 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-02 09:04:09,236 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d322e70296c63ab26eb9f71bef1bf950: 2023-10-02 09:04:09,236 INFO [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 9b9981c7b2f70cb0c2a19d2ca504fdfc in 50ms, sequenceid=6, compaction requested=false 2023-10-02 09:04:09,236 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,238 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:04:09,238 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b9981c7b2f70cb0c2a19d2ca504fdfc: 2023-10-02 09:04:09,238 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/cf/2507fd5daf564283a090a6b1f3772ae8] hfiles 2023-10-02 09:04:09,238 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/cf/2507fd5daf564283a090a6b1f3772ae8 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,238 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,238 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 09:04:09,238 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/cf/413ad490a74c4bc8bf9e38f5a1f7919e] hfiles 2023-10-02 09:04:09,238 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/cf/413ad490a74c4bc8bf9e38f5a1f7919e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,241 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:04:09,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 09:04:09,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-02 09:04:09,242 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 09:04:09,253 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. completed. 2023-10-02 09:04:09,253 DEBUG [rs(jenkins-hbase4.apache.org,40077,1696237348884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:09,253 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:04:09,253 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:04:09,253 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,253 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 09:04:09,253 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40077,1696237348884' in zk 2023-10-02 09:04:09,255 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,255 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 09:04:09,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:04:09,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:04:09,255 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:04:09,255 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. completed. 2023-10-02 09:04:09,255 DEBUG [rs(jenkins-hbase4.apache.org,44871,1696237348922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:09,255 DEBUG [member: 'jenkins-hbase4.apache.org,40077,1696237348884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 09:04:09,257 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 09:04:09,257 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 09:04:09,257 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:04:09,257 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 09:04:09,257 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44871,1696237348922' in zk 2023-10-02 09:04:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:04:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,259 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,259 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 09:04:09,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,259 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:04:09,259 DEBUG [member: 'jenkins-hbase4.apache.org,44871,1696237348922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 09:04:09,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:04:09,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40077,1696237348884': 2023-10-02 09:04:09,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40077,1696237348884' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-02 09:04:09,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:04:09,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:04:09,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:04:09,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:04:09,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:04:09,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44871,1696237348922': 2023-10-02 09:04:09,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44871,1696237348922' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-02 09:04:09,266 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-02 09:04:09,266 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 09:04:09,266 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 09:04:09,266 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,266 INFO [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 09:04:09,267 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,267 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,268 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 09:04:09,268 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 09:04:09,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,268 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 09:04:09,268 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:09,268 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,268 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:09,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:09,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:09,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:09,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,269 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 09:04:09,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,269 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 09:04:09,271 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,271 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,271 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,275 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:09,275 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:09,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:09,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:09,275 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:09,275 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 09:04:09,275 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 09:04:09,275 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:09,276 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,275 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:09,275 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 09:04:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 09:04:09,276 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,276 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,276 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:09,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:09,276 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:09,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 09:04:09,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 09:04:09,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 09:04:09,276 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:09,276 DEBUG [(jenkins-hbase4.apache.org,39745,1696237347579)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 09:04:09,277 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:09,277 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,278 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231002b381e96ba7954702b8e7e971e9f10317, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002b70b4514b1d14a4ea0e08b23b4a705ea] mob files 2023-10-02 09:04:09,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231002b381e96ba7954702b8e7e971e9f10317 2023-10-02 09:04:09,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002b70b4514b1d14a4ea0e08b23b4a705ea 2023-10-02 09:04:09,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-02 09:04:09,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,306 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696237449140Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696237449285 (+145 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696237449286 (+1 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696237449286Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696237449289 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696237449298 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696237449305 (+7 ms) 2023-10-02 09:04:09,309 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 09:04:09,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 168 msec 2023-10-02 09:04:09,443 DEBUG [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 09:04:09,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 09:04:09,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 09:04:09,444 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237449444 2023-10-02 09:04:09,444 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44077, tgtDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237449444, rawTgtDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237449444, srcFsUri=hdfs://localhost:44077, srcDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:04:09,466 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247 2023-10-02 09:04:09,466 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1460608179_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237449444, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237449444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,466 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44077, inputRoot=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247, snapshotDir=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-02 09:04:09,475 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237449444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:09,490 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:09,491 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:09,491 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:09,491 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:10,361 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-1948557962809825211.jar 2023-10-02 09:04:10,362 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:10,362 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:10,428 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/hadoop-9037300068470393564.jar 2023-10-02 09:04:10,429 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:10,429 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:10,430 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:10,430 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:10,430 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:10,431 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 09:04:10,431 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 09:04:10,431 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 09:04:10,432 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 09:04:10,432 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 09:04:10,432 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 09:04:10,433 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 09:04:10,433 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 09:04:10,433 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 09:04:10,434 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 09:04:10,434 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 09:04:10,435 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:04:10,435 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:04:10,436 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:04:10,436 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:04:10,436 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 09:04:10,436 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:04:10,437 DEBUG [Listener at jenkins-hbase4.apache.org/35395] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 09:04:10,776 WARN [Listener at jenkins-hbase4.apache.org/35395] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 09:04:10,778 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-02 09:04:10,780 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-02 09:04:12,087 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:04:12,087 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 09:04:12,089 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0006_000001 (auth:SIMPLE) 2023-10-02 09:04:12,464 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0007_000001 (auth:SIMPLE) 2023-10-02 09:04:13,416 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 09:04:16,360 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0007_000001 (auth:SIMPLE) 2023-10-02 09:04:18,581 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0007_000001 (auth:SIMPLE) 2023-10-02 09:04:21,153 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696237355285_0007_000001 (auth:SIMPLE) 2023-10-02 09:04:22,946 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 09:04:22,946 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 09:04:22,958 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:22,958 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 09:04:22,958 INFO [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 09:04:22,958 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:22,959 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-02 09:04:22,959 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-02 09:04:22,959 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1851388388_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237449444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237449444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:22,959 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237449444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-02 09:04:22,959 DEBUG [Listener at jenkins-hbase4.apache.org/35395] snapshot.TestExportSnapshot(367): hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/export-test/export-1696237449444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-02 09:04:22,965 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:22,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:22,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:22,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 09:04:22,969 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237462969"}]},"ts":"1696237462969"} 2023-10-02 09:04:22,970 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-02 09:04:22,972 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-02 09:04:22,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d322e70296c63ab26eb9f71bef1bf950, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b9981c7b2f70cb0c2a19d2ca504fdfc, UNASSIGN}] 2023-10-02 09:04:22,974 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d322e70296c63ab26eb9f71bef1bf950, UNASSIGN 2023-10-02 09:04:22,974 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b9981c7b2f70cb0c2a19d2ca504fdfc, UNASSIGN 2023-10-02 09:04:22,975 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d322e70296c63ab26eb9f71bef1bf950, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:22,975 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9b9981c7b2f70cb0c2a19d2ca504fdfc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:22,975 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696237462975"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237462975"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237462975"}]},"ts":"1696237462975"} 2023-10-02 09:04:22,975 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696237462975"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696237462975"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696237462975"}]},"ts":"1696237462975"} 2023-10-02 09:04:22,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure d322e70296c63ab26eb9f71bef1bf950, server=jenkins-hbase4.apache.org,40077,1696237348884}] 2023-10-02 09:04:22,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 9b9981c7b2f70cb0c2a19d2ca504fdfc, server=jenkins-hbase4.apache.org,44871,1696237348922}] 2023-10-02 09:04:23,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 09:04:23,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:23,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:23,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d322e70296c63ab26eb9f71bef1bf950, disabling compactions & flushes 2023-10-02 09:04:23,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9b9981c7b2f70cb0c2a19d2ca504fdfc, disabling compactions & flushes 2023-10-02 09:04:23,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:23,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:23,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:23,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:23,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. after waiting 0 ms 2023-10-02 09:04:23,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. after waiting 0 ms 2023-10-02 09:04:23,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:23,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:23,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:04:23,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:04:23,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:23,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:23,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc. 2023-10-02 09:04:23,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950. 2023-10-02 09:04:23,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9b9981c7b2f70cb0c2a19d2ca504fdfc: 2023-10-02 09:04:23,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d322e70296c63ab26eb9f71bef1bf950: 2023-10-02 09:04:23,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:23,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d322e70296c63ab26eb9f71bef1bf950, regionState=CLOSED 2023-10-02 09:04:23,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:23,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696237463144"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237463144"}]},"ts":"1696237463144"} 2023-10-02 09:04:23,145 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9b9981c7b2f70cb0c2a19d2ca504fdfc, regionState=CLOSED 2023-10-02 09:04:23,145 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696237463145"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696237463145"}]},"ts":"1696237463145"} 2023-10-02 09:04:23,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-02 09:04:23,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure d322e70296c63ab26eb9f71bef1bf950, server=jenkins-hbase4.apache.org,40077,1696237348884 in 170 msec 2023-10-02 09:04:23,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-02 09:04:23,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 9b9981c7b2f70cb0c2a19d2ca504fdfc, server=jenkins-hbase4.apache.org,44871,1696237348922 in 169 msec 2023-10-02 09:04:23,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d322e70296c63ab26eb9f71bef1bf950, UNASSIGN in 175 msec 2023-10-02 09:04:23,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-02 09:04:23,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b9981c7b2f70cb0c2a19d2ca504fdfc, UNASSIGN in 176 msec 2023-10-02 09:04:23,151 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696237463151"}]},"ts":"1696237463151"} 2023-10-02 09:04:23,152 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-02 09:04:23,154 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-02 09:04:23,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 189 msec 2023-10-02 09:04:23,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 09:04:23,271 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-02 09:04:23,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,275 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,276 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,277 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40077] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,279 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:23,279 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:23,280 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,281 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,281 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,281 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 09:04:23,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 09:04:23,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 09:04:23,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 09:04:23,282 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/recovered.edits] 2023-10-02 09:04:23,282 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/cf, FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/recovered.edits] 2023-10-02 09:04:23,282 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,282 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,282 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,282 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,282 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:23,282 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:23,282 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:23,282 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 09:04:23,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-02 09:04:23,286 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/cf/2507fd5daf564283a090a6b1f3772ae8 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/cf/2507fd5daf564283a090a6b1f3772ae8 2023-10-02 09:04:23,286 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/cf/413ad490a74c4bc8bf9e38f5a1f7919e to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/cf/413ad490a74c4bc8bf9e38f5a1f7919e 2023-10-02 09:04:23,289 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950/recovered.edits/9.seqid 2023-10-02 09:04:23,289 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d322e70296c63ab26eb9f71bef1bf950 2023-10-02 09:04:23,290 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/recovered.edits/9.seqid to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc/recovered.edits/9.seqid 2023-10-02 09:04:23,290 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b9981c7b2f70cb0c2a19d2ca504fdfc 2023-10-02 09:04:23,290 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-02 09:04:23,291 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-02 09:04:23,291 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-02 09:04:23,294 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231002b381e96ba7954702b8e7e971e9f10317 to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231002b381e96ba7954702b8e7e971e9f10317 2023-10-02 09:04:23,296 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002b70b4514b1d14a4ea0e08b23b4a705ea to hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002b70b4514b1d14a4ea0e08b23b4a705ea 2023-10-02 09:04:23,296 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-02 09:04:23,298 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,299 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-02 09:04:23,301 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-02 09:04:23,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-02 09:04:23,302 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237463302"}]},"ts":"9223372036854775807"} 2023-10-02 09:04:23,302 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696237463302"}]},"ts":"9223372036854775807"} 2023-10-02 09:04:23,304 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 09:04:23,304 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d322e70296c63ab26eb9f71bef1bf950, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696237448123.d322e70296c63ab26eb9f71bef1bf950.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9b9981c7b2f70cb0c2a19d2ca504fdfc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696237448123.9b9981c7b2f70cb0c2a19d2ca504fdfc.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 09:04:23,304 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-02 09:04:23,304 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696237463304"}]},"ts":"9223372036854775807"} 2023-10-02 09:04:23,305 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-02 09:04:23,307 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-10-02 09:04:23,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-02 09:04:23,385 INFO [Listener at jenkins-hbase4.apache.org/35395] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-02 09:04:23,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-02 09:04:23,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-02 09:04:23,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39745] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 09:04:23,419 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 765), OpenFileDescriptor=909 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=167 (was 223), ProcessCount=173 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=1151 (was 1231) 2023-10-02 09:04:23,419 WARN [Listener at jenkins-hbase4.apache.org/35395] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-02 09:04:23,419 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-02 09:04:23,430 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 09:04:23,541 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696237355285_0007_01_000001 is : 143 2023-10-02 09:04:28,709 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 09:04:37,551 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 09:04:51,665 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 09:04:51,665 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 09:04:51,773 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-02 09:04:51,780 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-02 09:04:51,782 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 09:04:51,787 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 09:04:51,891 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 09:04:51,891 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-02 09:04:51,891 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-02 09:04:51,891 INFO [Listener at jenkins-hbase4.apache.org/35395] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-02 09:04:51,891 DEBUG [Listener at jenkins-hbase4.apache.org/35395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bcebd71 to 127.0.0.1:60549 2023-10-02 09:04:51,891 DEBUG [Listener at jenkins-hbase4.apache.org/35395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:51,892 DEBUG [Listener at jenkins-hbase4.apache.org/35395] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-02 09:04:51,892 DEBUG [Listener at jenkins-hbase4.apache.org/35395] util.JVMClusterUtil(257): Found active master hash=1606549620, stopped=false 2023-10-02 09:04:51,892 DEBUG [Listener at jenkins-hbase4.apache.org/35395] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:51,892 DEBUG [Listener at jenkins-hbase4.apache.org/35395] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-02 09:04:51,892 INFO [Listener at jenkins-hbase4.apache.org/35395] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39745,1696237347579 2023-10-02 09:04:51,894 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 09:04:51,894 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 09:04:51,894 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:04:51,894 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 09:04:51,894 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 09:04:51,894 INFO [Listener at jenkins-hbase4.apache.org/35395] procedure2.ProcedureExecutor(628): Stopping 2023-10-02 09:04:51,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 09:04:51,894 DEBUG [Listener at jenkins-hbase4.apache.org/35395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56d91bb7 to 127.0.0.1:60549 2023-10-02 09:04:51,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 09:04:51,894 DEBUG [Listener at jenkins-hbase4.apache.org/35395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:51,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 09:04:51,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 09:04:51,895 INFO [Listener at jenkins-hbase4.apache.org/35395] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39697,1696237348836' ***** 2023-10-02 09:04:51,895 DEBUG [Listener at jenkins-hbase4.apache.org/35395] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:51,895 INFO [Listener at jenkins-hbase4.apache.org/35395] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 09:04:51,895 INFO [Listener at jenkins-hbase4.apache.org/35395] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40077,1696237348884' ***** 2023-10-02 09:04:51,895 DEBUG [Listener at jenkins-hbase4.apache.org/35395] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:51,895 INFO [Listener at jenkins-hbase4.apache.org/35395] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 09:04:51,895 INFO [RS:0;jenkins-hbase4:39697] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 09:04:51,895 INFO [Listener at jenkins-hbase4.apache.org/35395] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44871,1696237348922' ***** 2023-10-02 09:04:51,895 DEBUG [Listener at jenkins-hbase4.apache.org/35395] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:51,895 INFO [RS:0;jenkins-hbase4:39697] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 09:04:51,896 INFO [RS:1;jenkins-hbase4:40077] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 09:04:51,896 INFO [Listener at jenkins-hbase4.apache.org/35395] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 09:04:51,896 INFO [RS:1;jenkins-hbase4:40077] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 09:04:51,896 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 09:04:51,896 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 09:04:51,896 INFO [RS:2;jenkins-hbase4:44871] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 09:04:51,896 INFO [RS:2;jenkins-hbase4:44871] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 09:04:51,896 INFO [RS:2;jenkins-hbase4:44871] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 09:04:51,896 INFO [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:51,896 DEBUG [RS:2;jenkins-hbase4:44871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a15cde8 to 127.0.0.1:60549 2023-10-02 09:04:51,896 DEBUG [RS:2;jenkins-hbase4:44871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:51,896 INFO [RS:0;jenkins-hbase4:39697] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 09:04:51,899 INFO [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44871,1696237348922; all regions closed. 2023-10-02 09:04:51,899 INFO [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:51,896 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 09:04:51,896 INFO [RS:1;jenkins-hbase4:40077] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 09:04:51,899 DEBUG [RS:0;jenkins-hbase4:39697] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3867f8c3 to 127.0.0.1:60549 2023-10-02 09:04:51,899 DEBUG [RS:0;jenkins-hbase4:39697] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:51,900 INFO [RS:0;jenkins-hbase4:39697] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 09:04:51,900 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(3305): Received CLOSE for d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:04:51,900 INFO [RS:0;jenkins-hbase4:39697] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 09:04:51,900 INFO [RS:0;jenkins-hbase4:39697] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 09:04:51,900 INFO [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-02 09:04:51,900 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(3305): Received CLOSE for c4d1ef49830f04f4a5795778158a97b4 2023-10-02 09:04:51,900 INFO [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-02 09:04:51,900 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:51,901 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-02 09:04:51,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d9668d971920f0d14918e01ea0cb573c, disabling compactions & flushes 2023-10-02 09:04:51,901 DEBUG [RS:1;jenkins-hbase4:40077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62193a57 to 127.0.0.1:60549 2023-10-02 09:04:51,901 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-02 09:04:51,902 DEBUG [RS:1;jenkins-hbase4:40077] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:51,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:04:51,902 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-02 09:04:51,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:04:51,902 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-02 09:04:51,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. after waiting 0 ms 2023-10-02 09:04:51,902 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1478): Online Regions={d9668d971920f0d14918e01ea0cb573c=hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c., c4d1ef49830f04f4a5795778158a97b4=hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4.} 2023-10-02 09:04:51,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:04:51,902 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-02 09:04:51,903 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-02 09:04:51,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d9668d971920f0d14918e01ea0cb573c 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-02 09:04:51,903 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-02 09:04:51,903 DEBUG [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-02 09:04:51,903 DEBUG [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1504): Waiting on c4d1ef49830f04f4a5795778158a97b4, d9668d971920f0d14918e01ea0cb573c 2023-10-02 09:04:51,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-02 09:04:51,918 DEBUG [RS:2;jenkins-hbase4:44871] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/oldWALs 2023-10-02 09:04:51,918 INFO [RS:2;jenkins-hbase4:44871] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44871%2C1696237348922:(num 1696237350594) 2023-10-02 09:04:51,918 DEBUG [RS:2;jenkins-hbase4:44871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:51,918 INFO [RS:2;jenkins-hbase4:44871] regionserver.LeaseManager(133): Closed leases 2023-10-02 09:04:51,918 INFO [RS:2;jenkins-hbase4:44871] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-02 09:04:51,918 INFO [RS:2;jenkins-hbase4:44871] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 09:04:51,919 INFO [RS:2;jenkins-hbase4:44871] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 09:04:51,919 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 09:04:51,919 INFO [RS:2;jenkins-hbase4:44871] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 09:04:51,925 INFO [RS:2;jenkins-hbase4:44871] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44871 2023-10-02 09:04:51,932 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 09:04:51,932 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:51,932 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:51,932 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 09:04:51,932 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44871,1696237348922 2023-10-02 09:04:51,932 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 09:04:51,932 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 09:04:51,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c/.tmp/l/357f9dcd3b9341c7831c9670bf556c8b 2023-10-02 09:04:51,932 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/.tmp/info/44e35b2a1c4b4128bd489e5249e37c3e 2023-10-02 09:04:51,933 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44871,1696237348922] 2023-10-02 09:04:51,934 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44871,1696237348922; numProcessing=1 2023-10-02 09:04:51,937 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44871,1696237348922 already deleted, retry=false 2023-10-02 09:04:51,937 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44871,1696237348922 expired; onlineServers=2 2023-10-02 09:04:51,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44e35b2a1c4b4128bd489e5249e37c3e 2023-10-02 09:04:51,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 357f9dcd3b9341c7831c9670bf556c8b 2023-10-02 09:04:51,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c/.tmp/l/357f9dcd3b9341c7831c9670bf556c8b as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c/l/357f9dcd3b9341c7831c9670bf556c8b 2023-10-02 09:04:51,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 357f9dcd3b9341c7831c9670bf556c8b 2023-10-02 09:04:51,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c/l/357f9dcd3b9341c7831c9670bf556c8b, entries=7, sequenceid=18, filesize=5.2 K 2023-10-02 09:04:51,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for d9668d971920f0d14918e01ea0cb573c in 45ms, sequenceid=18, compaction requested=false 2023-10-02 09:04:51,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/.tmp/rep_barrier/dd0120c00e174c7eaa384dd2f164b001 2023-10-02 09:04:51,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/acl/d9668d971920f0d14918e01ea0cb573c/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-02 09:04:51,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:51,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:04:51,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d9668d971920f0d14918e01ea0cb573c: 2023-10-02 09:04:51,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696237351782.d9668d971920f0d14918e01ea0cb573c. 2023-10-02 09:04:51,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c4d1ef49830f04f4a5795778158a97b4, disabling compactions & flushes 2023-10-02 09:04:51,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:04:51,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:04:51,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. after waiting 0 ms 2023-10-02 09:04:51,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:04:51,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c4d1ef49830f04f4a5795778158a97b4 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-02 09:04:51,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd0120c00e174c7eaa384dd2f164b001 2023-10-02 09:04:51,965 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 09:04:51,965 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 09:04:51,965 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 09:04:51,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4/.tmp/info/55d48a44f17c4560b917c2fe08deda02 2023-10-02 09:04:51,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/.tmp/table/cbc3c339af034a47b18a0dca3c6e89c0 2023-10-02 09:04:51,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cbc3c339af034a47b18a0dca3c6e89c0 2023-10-02 09:04:51,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4/.tmp/info/55d48a44f17c4560b917c2fe08deda02 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4/info/55d48a44f17c4560b917c2fe08deda02 2023-10-02 09:04:51,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/.tmp/info/44e35b2a1c4b4128bd489e5249e37c3e as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/info/44e35b2a1c4b4128bd489e5249e37c3e 2023-10-02 09:04:51,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4/info/55d48a44f17c4560b917c2fe08deda02, entries=2, sequenceid=6, filesize=4.8 K 2023-10-02 09:04:51,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44e35b2a1c4b4128bd489e5249e37c3e 2023-10-02 09:04:51,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/info/44e35b2a1c4b4128bd489e5249e37c3e, entries=48, sequenceid=131, filesize=10.3 K 2023-10-02 09:04:51,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c4d1ef49830f04f4a5795778158a97b4 in 24ms, sequenceid=6, compaction requested=false 2023-10-02 09:04:51,986 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/.tmp/rep_barrier/dd0120c00e174c7eaa384dd2f164b001 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/rep_barrier/dd0120c00e174c7eaa384dd2f164b001 2023-10-02 09:04:51,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/namespace/c4d1ef49830f04f4a5795778158a97b4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 09:04:51,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:51,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:04:51,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c4d1ef49830f04f4a5795778158a97b4: 2023-10-02 09:04:51,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696237351026.c4d1ef49830f04f4a5795778158a97b4. 2023-10-02 09:04:51,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd0120c00e174c7eaa384dd2f164b001 2023-10-02 09:04:51,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/rep_barrier/dd0120c00e174c7eaa384dd2f164b001, entries=13, sequenceid=131, filesize=6.4 K 2023-10-02 09:04:51,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/.tmp/table/cbc3c339af034a47b18a0dca3c6e89c0 as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/table/cbc3c339af034a47b18a0dca3c6e89c0 2023-10-02 09:04:51,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cbc3c339af034a47b18a0dca3c6e89c0 2023-10-02 09:04:51,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/table/cbc3c339af034a47b18a0dca3c6e89c0, entries=24, sequenceid=131, filesize=6.9 K 2023-10-02 09:04:51,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 96ms, sequenceid=131, compaction requested=false 2023-10-02 09:04:52,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-02 09:04:52,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 09:04:52,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-02 09:04:52,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-02 09:04:52,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-02 09:04:52,010 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-02 09:04:52,033 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 09:04:52,033 INFO [RS:2;jenkins-hbase4:44871] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44871,1696237348922; zookeeper connection closed. 2023-10-02 09:04:52,033 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:44871-0x101065f16b50003, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 09:04:52,034 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@c83ff9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@c83ff9 2023-10-02 09:04:52,103 INFO [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39697,1696237348836; all regions closed. 2023-10-02 09:04:52,103 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40077,1696237348884; all regions closed. 2023-10-02 09:04:52,112 DEBUG [RS:0;jenkins-hbase4:39697] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/oldWALs 2023-10-02 09:04:52,112 INFO [RS:0;jenkins-hbase4:39697] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39697%2C1696237348836.meta:.meta(num 1696237350733) 2023-10-02 09:04:52,114 DEBUG [RS:1;jenkins-hbase4:40077] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/oldWALs 2023-10-02 09:04:52,114 INFO [RS:1;jenkins-hbase4:40077] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40077%2C1696237348884:(num 1696237350583) 2023-10-02 09:04:52,114 DEBUG [RS:1;jenkins-hbase4:40077] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:52,114 INFO [RS:1;jenkins-hbase4:40077] regionserver.LeaseManager(133): Closed leases 2023-10-02 09:04:52,115 INFO [RS:1;jenkins-hbase4:40077] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-02 09:04:52,116 INFO [RS:1;jenkins-hbase4:40077] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 09:04:52,116 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 09:04:52,116 INFO [RS:1;jenkins-hbase4:40077] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 09:04:52,117 INFO [RS:1;jenkins-hbase4:40077] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 09:04:52,118 INFO [RS:1;jenkins-hbase4:40077] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40077 2023-10-02 09:04:52,119 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:52,119 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40077,1696237348884 2023-10-02 09:04:52,119 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 09:04:52,121 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40077,1696237348884] 2023-10-02 09:04:52,121 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40077,1696237348884; numProcessing=2 2023-10-02 09:04:52,121 DEBUG [RS:0;jenkins-hbase4:39697] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/oldWALs 2023-10-02 09:04:52,121 INFO [RS:0;jenkins-hbase4:39697] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39697%2C1696237348836:(num 1696237350594) 2023-10-02 09:04:52,121 DEBUG [RS:0;jenkins-hbase4:39697] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:52,121 INFO [RS:0;jenkins-hbase4:39697] regionserver.LeaseManager(133): Closed leases 2023-10-02 09:04:52,122 INFO [RS:0;jenkins-hbase4:39697] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-02 09:04:52,122 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 09:04:52,122 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40077,1696237348884 already deleted, retry=false 2023-10-02 09:04:52,122 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40077,1696237348884 expired; onlineServers=1 2023-10-02 09:04:52,125 INFO [RS:0;jenkins-hbase4:39697] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39697 2023-10-02 09:04:52,128 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 09:04:52,128 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39697,1696237348836 2023-10-02 09:04:52,130 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39697,1696237348836] 2023-10-02 09:04:52,130 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39697,1696237348836; numProcessing=3 2023-10-02 09:04:52,131 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39697,1696237348836 already deleted, retry=false 2023-10-02 09:04:52,131 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39697,1696237348836 expired; onlineServers=0 2023-10-02 09:04:52,131 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39745,1696237347579' ***** 2023-10-02 09:04:52,131 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-02 09:04:52,131 DEBUG [M:0;jenkins-hbase4:39745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eff0a4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 09:04:52,131 INFO [M:0;jenkins-hbase4:39745] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39745,1696237347579 2023-10-02 09:04:52,131 INFO [M:0;jenkins-hbase4:39745] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39745,1696237347579; all regions closed. 2023-10-02 09:04:52,131 DEBUG [M:0;jenkins-hbase4:39745] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 09:04:52,131 DEBUG [M:0;jenkins-hbase4:39745] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-02 09:04:52,131 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-02 09:04:52,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696237350213] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696237350213,5,FailOnTimeoutGroup] 2023-10-02 09:04:52,132 DEBUG [M:0;jenkins-hbase4:39745] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-02 09:04:52,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696237350213] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696237350213,5,FailOnTimeoutGroup] 2023-10-02 09:04:52,132 INFO [M:0;jenkins-hbase4:39745] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-02 09:04:52,132 INFO [M:0;jenkins-hbase4:39745] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-02 09:04:52,132 INFO [M:0;jenkins-hbase4:39745] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-02 09:04:52,132 DEBUG [M:0;jenkins-hbase4:39745] master.HMaster(1512): Stopping service threads 2023-10-02 09:04:52,132 INFO [M:0;jenkins-hbase4:39745] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-02 09:04:52,132 ERROR [M:0;jenkins-hbase4:39745] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-02 09:04:52,132 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-02 09:04:52,133 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 09:04:52,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 09:04:52,133 INFO [M:0;jenkins-hbase4:39745] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-02 09:04:52,133 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-02 09:04:52,133 DEBUG [M:0;jenkins-hbase4:39745] zookeeper.ZKUtil(398): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-02 09:04:52,133 WARN [M:0;jenkins-hbase4:39745] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-02 09:04:52,133 INFO [M:0;jenkins-hbase4:39745] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-02 09:04:52,134 INFO [M:0;jenkins-hbase4:39745] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-02 09:04:52,134 DEBUG [M:0;jenkins-hbase4:39745] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-02 09:04:52,134 INFO [M:0;jenkins-hbase4:39745] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 09:04:52,134 DEBUG [M:0;jenkins-hbase4:39745] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 09:04:52,134 DEBUG [M:0;jenkins-hbase4:39745] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-02 09:04:52,134 DEBUG [M:0;jenkins-hbase4:39745] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 09:04:52,135 INFO [M:0;jenkins-hbase4:39745] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.69 KB heapSize=451.94 KB 2023-10-02 09:04:52,151 INFO [M:0;jenkins-hbase4:39745] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.69 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3dc955db2fc743768d0849dcbb8a693c 2023-10-02 09:04:52,155 INFO [M:0;jenkins-hbase4:39745] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3dc955db2fc743768d0849dcbb8a693c 2023-10-02 09:04:52,155 DEBUG [M:0;jenkins-hbase4:39745] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3dc955db2fc743768d0849dcbb8a693c as hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3dc955db2fc743768d0849dcbb8a693c 2023-10-02 09:04:52,160 INFO [M:0;jenkins-hbase4:39745] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3dc955db2fc743768d0849dcbb8a693c 2023-10-02 09:04:52,160 INFO [M:0;jenkins-hbase4:39745] regionserver.HStore(1080): Added hdfs://localhost:44077/user/jenkins/test-data/47aaa3df-c1c2-6468-87d9-985138a1a247/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3dc955db2fc743768d0849dcbb8a693c, entries=119, sequenceid=899, filesize=28.6 K 2023-10-02 09:04:52,161 INFO [M:0;jenkins-hbase4:39745] regionserver.HRegion(2948): Finished flush of dataSize ~375.69 KB/384703, heapSize ~451.92 KB/462768, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=899, compaction requested=false 2023-10-02 09:04:52,163 INFO [M:0;jenkins-hbase4:39745] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 09:04:52,163 DEBUG [M:0;jenkins-hbase4:39745] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 09:04:52,166 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 09:04:52,166 INFO [M:0;jenkins-hbase4:39745] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-02 09:04:52,167 INFO [M:0;jenkins-hbase4:39745] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39745 2023-10-02 09:04:52,170 DEBUG [M:0;jenkins-hbase4:39745] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39745,1696237347579 already deleted, retry=false 2023-10-02 09:04:52,221 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 09:04:52,221 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:40077-0x101065f16b50002, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 09:04:52,221 INFO [RS:1;jenkins-hbase4:40077] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40077,1696237348884; zookeeper connection closed. 2023-10-02 09:04:52,221 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@e97c968] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@e97c968 2023-10-02 09:04:52,321 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 09:04:52,321 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): master:39745-0x101065f16b50000, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 09:04:52,321 INFO [M:0;jenkins-hbase4:39745] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39745,1696237347579; zookeeper connection closed. 2023-10-02 09:04:52,421 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 09:04:52,421 INFO [RS:0;jenkins-hbase4:39697] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39697,1696237348836; zookeeper connection closed. 2023-10-02 09:04:52,421 DEBUG [Listener at localhost/38499-EventThread] zookeeper.ZKWatcher(600): regionserver:39697-0x101065f16b50001, quorum=127.0.0.1:60549, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 09:04:52,422 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@16efe6b4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@16efe6b4 2023-10-02 09:04:52,422 INFO [Listener at jenkins-hbase4.apache.org/35395] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-02 09:04:52,422 WARN [Listener at jenkins-hbase4.apache.org/35395] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 09:04:52,426 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 09:04:52,530 WARN [BP-1064902652-172.31.14.131-1696237343724 heartbeating to localhost/127.0.0.1:44077] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 09:04:52,530 WARN [BP-1064902652-172.31.14.131-1696237343724 heartbeating to localhost/127.0.0.1:44077] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1064902652-172.31.14.131-1696237343724 (Datanode Uuid 45ed5355-36b6-4719-8442-9382409ece71) service to localhost/127.0.0.1:44077 2023-10-02 09:04:52,533 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data5/current/BP-1064902652-172.31.14.131-1696237343724] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 09:04:52,533 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data6/current/BP-1064902652-172.31.14.131-1696237343724] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 09:04:52,534 WARN [Listener at jenkins-hbase4.apache.org/35395] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 09:04:52,536 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 09:04:52,639 WARN [BP-1064902652-172.31.14.131-1696237343724 heartbeating to localhost/127.0.0.1:44077] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 09:04:52,639 WARN [BP-1064902652-172.31.14.131-1696237343724 heartbeating to localhost/127.0.0.1:44077] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1064902652-172.31.14.131-1696237343724 (Datanode Uuid d78f62f4-c9aa-4a2e-a1d0-98a782557ed0) service to localhost/127.0.0.1:44077 2023-10-02 09:04:52,640 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data3/current/BP-1064902652-172.31.14.131-1696237343724] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 09:04:52,640 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data4/current/BP-1064902652-172.31.14.131-1696237343724] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 09:04:52,641 WARN [Listener at jenkins-hbase4.apache.org/35395] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 09:04:52,643 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 09:04:52,746 WARN [BP-1064902652-172.31.14.131-1696237343724 heartbeating to localhost/127.0.0.1:44077] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 09:04:52,746 WARN [BP-1064902652-172.31.14.131-1696237343724 heartbeating to localhost/127.0.0.1:44077] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1064902652-172.31.14.131-1696237343724 (Datanode Uuid a00f7a5a-a98a-48cf-99ff-77b9714fd031) service to localhost/127.0.0.1:44077 2023-10-02 09:04:52,746 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data1/current/BP-1064902652-172.31.14.131-1696237343724] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 09:04:52,747 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71f0606b-2469-8aef-567e-5acba448d6b0/cluster_5ecb0ebb-1294-7bc7-bf7d-26f77121c43b/dfs/data/data2/current/BP-1064902652-172.31.14.131-1696237343724] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 09:04:52,768 INFO [Listener at jenkins-hbase4.apache.org/35395] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 09:04:52,895 INFO [Listener at jenkins-hbase4.apache.org/35395] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-02 09:04:52,984 INFO [Listener at jenkins-hbase4.apache.org/35395] hbase.HBaseTestingUtility(1293): Minicluster is down