2023-10-02 13:02:18,872 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-02 13:02:19,080 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b 2023-10-02 13:02:19,080 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-02 13:02:19,081 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-02 13:02:19,121 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-02 13:02:19,393 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-02 13:02:19,394 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1, deleteOnExit=true 2023-10-02 13:02:19,394 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-02 13:02:19,395 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/test.cache.data in system properties and HBase conf 2023-10-02 13:02:19,395 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop.tmp.dir in system properties and HBase conf 2023-10-02 13:02:19,395 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop.log.dir in system properties and HBase conf 2023-10-02 13:02:19,396 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-02 13:02:19,396 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-02 13:02:19,396 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-02 13:02:19,745 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-02 13:02:19,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-02 13:02:19,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-02 13:02:19,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-02 13:02:19,751 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 13:02:19,751 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-02 13:02:19,751 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-02 13:02:19,751 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 13:02:19,752 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 13:02:19,752 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-02 13:02:19,752 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/nfs.dump.dir in system properties and HBase conf 2023-10-02 13:02:19,752 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/java.io.tmpdir in system properties and HBase conf 2023-10-02 13:02:19,753 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 13:02:19,753 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-02 13:02:19,753 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-02 13:02:20,254 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-02 13:02:20,260 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-02 13:02:20,600 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-02 13:02:20,796 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-02 13:02:20,813 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 13:02:20,856 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 13:02:20,908 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/java.io.tmpdir/Jetty_localhost_34347_hdfs____uo5c4f/webapp 2023-10-02 13:02:21,071 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34347 2023-10-02 13:02:21,083 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-02 13:02:21,083 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-02 13:02:21,609 WARN [Listener at localhost/35861] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 13:02:21,683 WARN [Listener at localhost/35861] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 13:02:21,706 WARN [Listener at localhost/35861] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 13:02:21,756 INFO [Listener at localhost/35861] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 13:02:21,761 INFO [Listener at localhost/35861] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/java.io.tmpdir/Jetty_localhost_33893_datanode____41qxuh/webapp 2023-10-02 13:02:21,871 INFO [Listener at localhost/35861] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33893 2023-10-02 13:02:22,245 WARN [Listener at localhost/38567] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 13:02:22,262 WARN [Listener at localhost/38567] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 13:02:22,267 WARN [Listener at localhost/38567] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 13:02:22,269 INFO [Listener at localhost/38567] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 13:02:22,280 INFO [Listener at localhost/38567] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/java.io.tmpdir/Jetty_localhost_35119_datanode____.7izbj6/webapp 2023-10-02 13:02:22,383 INFO [Listener at localhost/38567] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35119 2023-10-02 13:02:22,395 WARN [Listener at localhost/35597] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 13:02:22,416 WARN [Listener at localhost/35597] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 13:02:22,419 WARN [Listener at localhost/35597] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 13:02:22,421 INFO [Listener at localhost/35597] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 13:02:22,433 INFO [Listener at localhost/35597] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/java.io.tmpdir/Jetty_localhost_38425_datanode____.i1k10n/webapp 2023-10-02 13:02:22,583 INFO [Listener at localhost/35597] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38425 2023-10-02 13:02:22,597 WARN [Listener at localhost/39941] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 13:02:22,903 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5b49d47d0e36f46f: Processing first storage report for DS-853f6e0c-4f27-4efc-a86a-66443162dcfe from datanode bb8e0acc-9b06-498b-8ff2-a86cdbf263da 2023-10-02 13:02:22,905 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5b49d47d0e36f46f: from storage DS-853f6e0c-4f27-4efc-a86a-66443162dcfe node DatanodeRegistration(127.0.0.1:44641, datanodeUuid=bb8e0acc-9b06-498b-8ff2-a86cdbf263da, infoPort=45471, infoSecurePort=0, ipcPort=39941, storageInfo=lv=-57;cid=testClusterID;nsid=270503603;c=1696251740355), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-02 13:02:22,905 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb4d8a1af0e1e627a: Processing first storage report for DS-92dea7b1-31fc-4788-93ce-1baa72084cc0 from datanode ae2e7fea-8e65-4ccc-a1df-12a1627ce501 2023-10-02 13:02:22,905 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb4d8a1af0e1e627a: from storage DS-92dea7b1-31fc-4788-93ce-1baa72084cc0 node DatanodeRegistration(127.0.0.1:46113, datanodeUuid=ae2e7fea-8e65-4ccc-a1df-12a1627ce501, infoPort=42071, infoSecurePort=0, ipcPort=35597, storageInfo=lv=-57;cid=testClusterID;nsid=270503603;c=1696251740355), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-02 13:02:22,905 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f2b655fae883ed1: Processing first storage report for DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01 from datanode 72b1ad61-0944-477b-837c-744ba1f5e3eb 2023-10-02 13:02:22,906 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f2b655fae883ed1: from storage DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01 node DatanodeRegistration(127.0.0.1:35923, datanodeUuid=72b1ad61-0944-477b-837c-744ba1f5e3eb, infoPort=44899, infoSecurePort=0, ipcPort=38567, storageInfo=lv=-57;cid=testClusterID;nsid=270503603;c=1696251740355), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 13:02:22,906 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5b49d47d0e36f46f: Processing first storage report for DS-1fbece0c-3746-4fd4-8ccc-107b954fb32a from datanode bb8e0acc-9b06-498b-8ff2-a86cdbf263da 2023-10-02 13:02:22,906 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5b49d47d0e36f46f: from storage DS-1fbece0c-3746-4fd4-8ccc-107b954fb32a node DatanodeRegistration(127.0.0.1:44641, datanodeUuid=bb8e0acc-9b06-498b-8ff2-a86cdbf263da, infoPort=45471, infoSecurePort=0, ipcPort=39941, storageInfo=lv=-57;cid=testClusterID;nsid=270503603;c=1696251740355), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 13:02:22,906 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb4d8a1af0e1e627a: Processing first storage report for DS-7a26b19d-ebf4-46ef-85ca-53a4c7a7f51a from datanode ae2e7fea-8e65-4ccc-a1df-12a1627ce501 2023-10-02 13:02:22,906 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb4d8a1af0e1e627a: from storage DS-7a26b19d-ebf4-46ef-85ca-53a4c7a7f51a node DatanodeRegistration(127.0.0.1:46113, datanodeUuid=ae2e7fea-8e65-4ccc-a1df-12a1627ce501, infoPort=42071, infoSecurePort=0, ipcPort=35597, storageInfo=lv=-57;cid=testClusterID;nsid=270503603;c=1696251740355), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 13:02:22,906 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f2b655fae883ed1: Processing first storage report for DS-2f8cae30-f47b-4446-91f0-c0831ea7f024 from datanode 72b1ad61-0944-477b-837c-744ba1f5e3eb 2023-10-02 13:02:22,906 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f2b655fae883ed1: from storage DS-2f8cae30-f47b-4446-91f0-c0831ea7f024 node DatanodeRegistration(127.0.0.1:35923, datanodeUuid=72b1ad61-0944-477b-837c-744ba1f5e3eb, infoPort=44899, infoSecurePort=0, ipcPort=38567, storageInfo=lv=-57;cid=testClusterID;nsid=270503603;c=1696251740355), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-02 13:02:23,126 DEBUG [Listener at localhost/39941] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b 2023-10-02 13:02:23,221 INFO [Listener at localhost/39941] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/zookeeper_0, clientPort=55009, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-02 13:02:23,241 INFO [Listener at localhost/39941] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55009 2023-10-02 13:02:23,253 INFO [Listener at localhost/39941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:23,256 INFO [Listener at localhost/39941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:23,960 INFO [Listener at localhost/39941] util.FSUtils(471): Created version file at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c with version=8 2023-10-02 13:02:23,961 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/hbase-staging 2023-10-02 13:02:24,369 INFO [Listener at localhost/39941] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-02 13:02:24,900 INFO [Listener at localhost/39941] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 13:02:24,934 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:24,934 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:24,934 INFO [Listener at localhost/39941] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 13:02:24,935 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:24,935 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 13:02:25,077 INFO [Listener at localhost/39941] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 13:02:25,150 DEBUG [Listener at localhost/39941] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-02 13:02:25,244 INFO [Listener at localhost/39941] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34719 2023-10-02 13:02:25,260 INFO [Listener at localhost/39941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:25,263 INFO [Listener at localhost/39941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:25,291 INFO [Listener at localhost/39941] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34719 connecting to ZooKeeper ensemble=127.0.0.1:55009 2023-10-02 13:02:25,350 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:347190x0, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 13:02:25,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34719-0x101073ac3840000 connected 2023-10-02 13:02:25,383 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 13:02:25,383 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 13:02:25,396 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 13:02:25,404 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34719 2023-10-02 13:02:25,405 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34719 2023-10-02 13:02:25,409 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34719 2023-10-02 13:02:25,410 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34719 2023-10-02 13:02:25,410 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34719 2023-10-02 13:02:25,417 INFO [Listener at localhost/39941] master.HMaster(444): hbase.rootdir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c, hbase.cluster.distributed=false 2023-10-02 13:02:25,483 INFO [Listener at localhost/39941] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 13:02:25,483 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:25,483 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:25,483 INFO [Listener at localhost/39941] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 13:02:25,483 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:25,484 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 13:02:25,489 INFO [Listener at localhost/39941] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 13:02:25,492 INFO [Listener at localhost/39941] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46551 2023-10-02 13:02:25,494 INFO [Listener at localhost/39941] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 13:02:25,501 INFO [Listener at localhost/39941] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 13:02:25,502 INFO [Listener at localhost/39941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:25,504 INFO [Listener at localhost/39941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:25,507 INFO [Listener at localhost/39941] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46551 connecting to ZooKeeper ensemble=127.0.0.1:55009 2023-10-02 13:02:25,511 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:465510x0, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 13:02:25,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46551-0x101073ac3840001 connected 2023-10-02 13:02:25,513 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 13:02:25,514 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 13:02:25,515 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 13:02:25,516 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46551 2023-10-02 13:02:25,516 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46551 2023-10-02 13:02:25,517 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46551 2023-10-02 13:02:25,517 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46551 2023-10-02 13:02:25,518 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46551 2023-10-02 13:02:25,531 INFO [Listener at localhost/39941] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 13:02:25,532 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:25,532 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:25,533 INFO [Listener at localhost/39941] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 13:02:25,533 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:25,533 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 13:02:25,533 INFO [Listener at localhost/39941] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 13:02:25,537 INFO [Listener at localhost/39941] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46465 2023-10-02 13:02:25,538 INFO [Listener at localhost/39941] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 13:02:25,541 INFO [Listener at localhost/39941] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 13:02:25,542 INFO [Listener at localhost/39941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:25,545 INFO [Listener at localhost/39941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:25,549 INFO [Listener at localhost/39941] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46465 connecting to ZooKeeper ensemble=127.0.0.1:55009 2023-10-02 13:02:25,555 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:464650x0, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 13:02:25,556 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): regionserver:464650x0, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 13:02:25,557 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): regionserver:464650x0, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 13:02:25,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46465-0x101073ac3840002 connected 2023-10-02 13:02:25,558 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 13:02:25,562 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46465 2023-10-02 13:02:25,562 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46465 2023-10-02 13:02:25,562 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46465 2023-10-02 13:02:25,563 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46465 2023-10-02 13:02:25,565 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46465 2023-10-02 13:02:25,577 INFO [Listener at localhost/39941] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 13:02:25,578 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:25,578 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:25,578 INFO [Listener at localhost/39941] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 13:02:25,578 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 13:02:25,578 INFO [Listener at localhost/39941] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 13:02:25,578 INFO [Listener at localhost/39941] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 13:02:25,580 INFO [Listener at localhost/39941] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33895 2023-10-02 13:02:25,580 INFO [Listener at localhost/39941] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 13:02:25,581 INFO [Listener at localhost/39941] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 13:02:25,582 INFO [Listener at localhost/39941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:25,584 INFO [Listener at localhost/39941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:25,585 INFO [Listener at localhost/39941] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33895 connecting to ZooKeeper ensemble=127.0.0.1:55009 2023-10-02 13:02:25,589 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:338950x0, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 13:02:25,590 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): regionserver:338950x0, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 13:02:25,590 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): regionserver:338950x0, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 13:02:25,591 DEBUG [Listener at localhost/39941] zookeeper.ZKUtil(164): regionserver:338950x0, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 13:02:25,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33895-0x101073ac3840003 connected 2023-10-02 13:02:25,593 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33895 2023-10-02 13:02:25,594 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33895 2023-10-02 13:02:25,597 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33895 2023-10-02 13:02:25,601 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33895 2023-10-02 13:02:25,601 DEBUG [Listener at localhost/39941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33895 2023-10-02 13:02:25,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34719,1696251744198 2023-10-02 13:02:25,616 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-02 13:02:25,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34719,1696251744198 2023-10-02 13:02:25,638 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 13:02:25,638 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 13:02:25,638 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:02:25,638 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 13:02:25,638 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 13:02:25,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-02 13:02:25,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34719,1696251744198 from backup master directory 2023-10-02 13:02:25,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-02 13:02:25,647 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34719,1696251744198 2023-10-02 13:02:25,647 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-02 13:02:25,648 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 13:02:25,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34719,1696251744198 2023-10-02 13:02:25,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-02 13:02:25,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-02 13:02:25,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/hbase.id with ID: 1be698b8-1f40-49d4-bfc7-9a115f47999a 2023-10-02 13:02:25,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 13:02:25,809 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:02:25,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1a801a58 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:25,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ade3e5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:25,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-02 13:02:25,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-02 13:02:25,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-02 13:02:25,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-02 13:02:25,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-02 13:02:25,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-02 13:02:25,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 13:02:25,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/data/master/store-tmp 2023-10-02 13:02:26,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:26,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-02 13:02:26,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 13:02:26,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 13:02:26,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-02 13:02:26,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 13:02:26,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 13:02:26,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 13:02:26,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/WALs/jenkins-hbase4.apache.org,34719,1696251744198 2023-10-02 13:02:26,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34719%2C1696251744198, suffix=, logDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/WALs/jenkins-hbase4.apache.org,34719,1696251744198, archiveDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/oldWALs, maxLogs=10 2023-10-02 13:02:26,120 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46113,DS-92dea7b1-31fc-4788-93ce-1baa72084cc0,DISK] 2023-10-02 13:02:26,120 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44641,DS-853f6e0c-4f27-4efc-a86a-66443162dcfe,DISK] 2023-10-02 13:02:26,120 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35923,DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01,DISK] 2023-10-02 13:02:26,130 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-02 13:02:26,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/WALs/jenkins-hbase4.apache.org,34719,1696251744198/jenkins-hbase4.apache.org%2C34719%2C1696251744198.1696251746063 2023-10-02 13:02:26,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35923,DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01,DISK], DatanodeInfoWithStorage[127.0.0.1:46113,DS-92dea7b1-31fc-4788-93ce-1baa72084cc0,DISK], DatanodeInfoWithStorage[127.0.0.1:44641,DS-853f6e0c-4f27-4efc-a86a-66443162dcfe,DISK]] 2023-10-02 13:02:26,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-02 13:02:26,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:26,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 13:02:26,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 13:02:26,269 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-02 13:02:26,276 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-02 13:02:26,304 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-02 13:02:26,317 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:26,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-02 13:02:26,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-02 13:02:26,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 13:02:26,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:02:26,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69798290, jitterRate=0.04007557034492493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:02:26,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 13:02:26,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-02 13:02:26,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-02 13:02:26,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-02 13:02:26,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-02 13:02:26,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-02 13:02:26,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-10-02 13:02:26,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-02 13:02:26,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-02 13:02:26,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-02 13:02:26,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-02 13:02:26,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-02 13:02:26,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-02 13:02:26,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-02 13:02:26,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-02 13:02:26,497 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:02:26,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-02 13:02:26,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-02 13:02:26,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-02 13:02:26,525 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 13:02:26,525 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 13:02:26,525 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 13:02:26,525 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 13:02:26,525 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:02:26,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34719,1696251744198, sessionid=0x101073ac3840000, setting cluster-up flag (Was=false) 2023-10-02 13:02:26,548 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:02:26,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-02 13:02:26,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34719,1696251744198 2023-10-02 13:02:26,561 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:02:26,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-02 13:02:26,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34719,1696251744198 2023-10-02 13:02:26,575 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp 2023-10-02 13:02:26,606 INFO [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(951): ClusterId : 1be698b8-1f40-49d4-bfc7-9a115f47999a 2023-10-02 13:02:26,606 INFO [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(951): ClusterId : 1be698b8-1f40-49d4-bfc7-9a115f47999a 2023-10-02 13:02:26,606 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(951): ClusterId : 1be698b8-1f40-49d4-bfc7-9a115f47999a 2023-10-02 13:02:26,614 DEBUG [RS:0;jenkins-hbase4:46551] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 13:02:26,614 DEBUG [RS:1;jenkins-hbase4:46465] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 13:02:26,614 DEBUG [RS:2;jenkins-hbase4:33895] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 13:02:26,621 DEBUG [RS:2;jenkins-hbase4:33895] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 13:02:26,621 DEBUG [RS:1;jenkins-hbase4:46465] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 13:02:26,621 DEBUG [RS:0;jenkins-hbase4:46551] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 13:02:26,621 DEBUG [RS:1;jenkins-hbase4:46465] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 13:02:26,621 DEBUG [RS:2;jenkins-hbase4:33895] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 13:02:26,621 DEBUG [RS:0;jenkins-hbase4:46551] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 13:02:26,626 DEBUG [RS:2;jenkins-hbase4:33895] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 13:02:26,626 DEBUG [RS:1;jenkins-hbase4:46465] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 13:02:26,626 DEBUG [RS:0;jenkins-hbase4:46551] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 13:02:26,630 DEBUG [RS:1;jenkins-hbase4:46465] zookeeper.ReadOnlyZKClient(139): Connect 0x7af20f95 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:26,631 DEBUG [RS:0;jenkins-hbase4:46551] zookeeper.ReadOnlyZKClient(139): Connect 0x7889fb15 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:26,631 DEBUG [RS:2;jenkins-hbase4:33895] zookeeper.ReadOnlyZKClient(139): Connect 0x7a04b44d to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:26,648 DEBUG [RS:1;jenkins-hbase4:46465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7435febb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:26,648 DEBUG [RS:2;jenkins-hbase4:33895] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74c3557d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:26,649 DEBUG [RS:1;jenkins-hbase4:46465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@700a64e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 13:02:26,649 DEBUG [RS:0;jenkins-hbase4:46551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@764e1a74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:26,649 DEBUG [RS:2;jenkins-hbase4:33895] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70fcdf3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 13:02:26,649 DEBUG [RS:0;jenkins-hbase4:46551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72719065, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 13:02:26,677 DEBUG [RS:1;jenkins-hbase4:46465] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46465 2023-10-02 13:02:26,677 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:33895 2023-10-02 13:02:26,677 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46551 2023-10-02 13:02:26,685 INFO [RS:1;jenkins-hbase4:46465] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 13:02:26,685 INFO [RS:0;jenkins-hbase4:46551] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 13:02:26,685 INFO [RS:0;jenkins-hbase4:46551] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 13:02:26,685 INFO [RS:2;jenkins-hbase4:33895] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 13:02:26,686 INFO [RS:2;jenkins-hbase4:33895] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 13:02:26,685 INFO [RS:1;jenkins-hbase4:46465] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 13:02:26,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-02 13:02:26,708 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 13:02:26,708 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 13:02:26,708 DEBUG [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 13:02:26,710 INFO [RS:1;jenkins-hbase4:46465] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:26,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:26,711 DEBUG [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 13:02:26,711 INFO [RS:2;jenkins-hbase4:33895] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:26,711 INFO [RS:0;jenkins-hbase4:46551] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:26,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-02 13:02:26,711 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 13:02:26,711 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 13:02:26,714 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34719,1696251744198 with isa=jenkins-hbase4.apache.org/172.31.14.131:46551, startcode=1696251745482 2023-10-02 13:02:26,714 INFO [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34719,1696251744198 with isa=jenkins-hbase4.apache.org/172.31.14.131:46465, startcode=1696251745531 2023-10-02 13:02:26,714 INFO [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34719,1696251744198 with isa=jenkins-hbase4.apache.org/172.31.14.131:33895, startcode=1696251745577 2023-10-02 13:02:26,736 DEBUG [RS:2;jenkins-hbase4:33895] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 13:02:26,736 DEBUG [RS:0;jenkins-hbase4:46551] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 13:02:26,736 DEBUG [RS:1;jenkins-hbase4:46465] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 13:02:26,823 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41071, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 13:02:26,823 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33017, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 13:02:26,823 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46903, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 13:02:26,834 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34719] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 13:02:26,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-02 13:02:26,842 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34719] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 13:02:26,844 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34719] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 13:02:26,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 13:02:26,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 13:02:26,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 13:02:26,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 13:02:26,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-02 13:02:26,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:26,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 13:02:26,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:26,869 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 13:02:26,869 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 13:02:26,869 WARN [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 13:02:26,869 WARN [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 13:02:26,869 DEBUG [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 13:02:26,869 WARN [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 13:02:26,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696251776870 2023-10-02 13:02:26,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-02 13:02:26,875 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-02 13:02:26,876 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-02 13:02:26,881 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 13:02:26,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-02 13:02:26,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-02 13:02:26,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-02 13:02:26,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-02 13:02:26,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-02 13:02:26,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:26,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-02 13:02:26,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-02 13:02:26,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-02 13:02:26,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-02 13:02:26,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-02 13:02:26,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696251746900,5,FailOnTimeoutGroup] 2023-10-02 13:02:26,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696251746900,5,FailOnTimeoutGroup] 2023-10-02 13:02:26,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:26,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-02 13:02:26,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:26,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:26,919 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-02 13:02:26,921 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-02 13:02:26,921 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:02:26,959 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:26,962 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-02 13:02:26,965 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/info 2023-10-02 13:02:26,966 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-02 13:02:26,966 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:26,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-02 13:02:26,970 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/rep_barrier 2023-10-02 13:02:26,970 INFO [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34719,1696251744198 with isa=jenkins-hbase4.apache.org/172.31.14.131:46465, startcode=1696251745531 2023-10-02 13:02:26,971 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34719,1696251744198 with isa=jenkins-hbase4.apache.org/172.31.14.131:46551, startcode=1696251745482 2023-10-02 13:02:26,971 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-02 13:02:26,971 INFO [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34719,1696251744198 with isa=jenkins-hbase4.apache.org/172.31.14.131:33895, startcode=1696251745577 2023-10-02 13:02:26,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:26,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-02 13:02:26,975 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/table 2023-10-02 13:02:26,976 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-02 13:02:26,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:26,978 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34719] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:26,979 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740 2023-10-02 13:02:26,980 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740 2023-10-02 13:02:26,985 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34719] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:26,985 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-02 13:02:26,986 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:02:26,986 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35861 2023-10-02 13:02:26,987 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 13:02:26,987 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34719] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:26,987 DEBUG [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:02:26,988 DEBUG [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35861 2023-10-02 13:02:26,988 DEBUG [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 13:02:26,989 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:02:26,990 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35861 2023-10-02 13:02:26,990 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 13:02:26,990 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-02 13:02:26,994 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 13:02:26,997 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:02:26,998 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75311492, jitterRate=0.12222868204116821}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-02 13:02:26,998 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-02 13:02:26,998 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-02 13:02:26,998 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-02 13:02:26,998 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-02 13:02:26,998 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-02 13:02:26,998 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-02 13:02:27,001 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-02 13:02:27,002 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-02 13:02:27,002 DEBUG [RS:0;jenkins-hbase4:46551] zookeeper.ZKUtil(162): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:27,002 WARN [RS:0;jenkins-hbase4:46551] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 13:02:27,003 INFO [RS:0;jenkins-hbase4:46551] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 13:02:27,003 DEBUG [RS:1;jenkins-hbase4:46465] zookeeper.ZKUtil(162): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:27,003 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:27,003 WARN [RS:1;jenkins-hbase4:46465] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 13:02:27,003 DEBUG [RS:2;jenkins-hbase4:33895] zookeeper.ZKUtil(162): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:27,004 WARN [RS:2;jenkins-hbase4:33895] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 13:02:27,005 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33895,1696251745577] 2023-10-02 13:02:27,005 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46465,1696251745531] 2023-10-02 13:02:27,005 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46551,1696251745482] 2023-10-02 13:02:27,003 INFO [RS:1;jenkins-hbase4:46465] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 13:02:27,006 DEBUG [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:27,004 INFO [RS:2;jenkins-hbase4:33895] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 13:02:27,007 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:27,009 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-02 13:02:27,010 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-02 13:02:27,023 DEBUG [RS:2;jenkins-hbase4:33895] zookeeper.ZKUtil(162): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:27,023 DEBUG [RS:1;jenkins-hbase4:46465] zookeeper.ZKUtil(162): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:27,023 DEBUG [RS:0;jenkins-hbase4:46551] zookeeper.ZKUtil(162): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:27,024 DEBUG [RS:2;jenkins-hbase4:33895] zookeeper.ZKUtil(162): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:27,024 DEBUG [RS:1;jenkins-hbase4:46465] zookeeper.ZKUtil(162): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:27,024 DEBUG [RS:0;jenkins-hbase4:46551] zookeeper.ZKUtil(162): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:27,025 DEBUG [RS:2;jenkins-hbase4:33895] zookeeper.ZKUtil(162): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:27,025 DEBUG [RS:1;jenkins-hbase4:46465] zookeeper.ZKUtil(162): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:27,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-02 13:02:27,026 DEBUG [RS:0;jenkins-hbase4:46551] zookeeper.ZKUtil(162): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:27,039 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 13:02:27,039 DEBUG [RS:1;jenkins-hbase4:46465] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 13:02:27,039 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 13:02:27,040 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-02 13:02:27,044 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-02 13:02:27,051 INFO [RS:0;jenkins-hbase4:46551] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 13:02:27,052 INFO [RS:1;jenkins-hbase4:46465] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 13:02:27,051 INFO [RS:2;jenkins-hbase4:33895] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 13:02:27,076 INFO [RS:1;jenkins-hbase4:46465] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 13:02:27,076 INFO [RS:0;jenkins-hbase4:46551] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 13:02:27,076 INFO [RS:2;jenkins-hbase4:33895] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 13:02:27,081 INFO [RS:1;jenkins-hbase4:46465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 13:02:27,081 INFO [RS:0;jenkins-hbase4:46551] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 13:02:27,081 INFO [RS:1;jenkins-hbase4:46465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,082 INFO [RS:0;jenkins-hbase4:46551] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,082 INFO [RS:2;jenkins-hbase4:33895] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 13:02:27,082 INFO [RS:2;jenkins-hbase4:33895] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,082 INFO [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 13:02:27,085 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 13:02:27,086 INFO [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 13:02:27,093 INFO [RS:0;jenkins-hbase4:46551] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,093 INFO [RS:2;jenkins-hbase4:33895] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,093 INFO [RS:1;jenkins-hbase4:46465] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,094 DEBUG [RS:0;jenkins-hbase4:46551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,094 DEBUG [RS:2;jenkins-hbase4:33895] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,094 DEBUG [RS:0;jenkins-hbase4:46551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,094 DEBUG [RS:1;jenkins-hbase4:46465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:0;jenkins-hbase4:46551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:1;jenkins-hbase4:46465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:0;jenkins-hbase4:46551] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:1;jenkins-hbase4:46465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:0;jenkins-hbase4:46551] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:1;jenkins-hbase4:46465] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:0;jenkins-hbase4:46551] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 13:02:27,095 DEBUG [RS:1;jenkins-hbase4:46465] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:0;jenkins-hbase4:46551] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:1;jenkins-hbase4:46465] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 13:02:27,095 DEBUG [RS:0;jenkins-hbase4:46551] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:1;jenkins-hbase4:46465] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:0;jenkins-hbase4:46551] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:1;jenkins-hbase4:46465] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,095 DEBUG [RS:0;jenkins-hbase4:46551] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,096 DEBUG [RS:1;jenkins-hbase4:46465] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,094 DEBUG [RS:2;jenkins-hbase4:33895] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,096 DEBUG [RS:1;jenkins-hbase4:46465] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,096 DEBUG [RS:2;jenkins-hbase4:33895] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,096 DEBUG [RS:2;jenkins-hbase4:33895] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,096 DEBUG [RS:2;jenkins-hbase4:33895] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,102 DEBUG [RS:2;jenkins-hbase4:33895] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 13:02:27,102 INFO [RS:0;jenkins-hbase4:46551] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,102 DEBUG [RS:2;jenkins-hbase4:33895] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,102 INFO [RS:0;jenkins-hbase4:46551] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,102 INFO [RS:1;jenkins-hbase4:46465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,102 INFO [RS:0;jenkins-hbase4:46551] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,102 INFO [RS:1;jenkins-hbase4:46465] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,102 DEBUG [RS:2;jenkins-hbase4:33895] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,102 INFO [RS:1;jenkins-hbase4:46465] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,102 DEBUG [RS:2;jenkins-hbase4:33895] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,103 DEBUG [RS:2;jenkins-hbase4:33895] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 13:02:27,107 INFO [RS:2;jenkins-hbase4:33895] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,107 INFO [RS:2;jenkins-hbase4:33895] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,107 INFO [RS:2;jenkins-hbase4:33895] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,122 INFO [RS:1;jenkins-hbase4:46465] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 13:02:27,122 INFO [RS:0;jenkins-hbase4:46551] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 13:02:27,124 INFO [RS:2;jenkins-hbase4:33895] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 13:02:27,126 INFO [RS:1;jenkins-hbase4:46465] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46465,1696251745531-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,126 INFO [RS:2;jenkins-hbase4:33895] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33895,1696251745577-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,126 INFO [RS:0;jenkins-hbase4:46551] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46551,1696251745482-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,145 INFO [RS:1;jenkins-hbase4:46465] regionserver.Replication(203): jenkins-hbase4.apache.org,46465,1696251745531 started 2023-10-02 13:02:27,145 INFO [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46465,1696251745531, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46465, sessionid=0x101073ac3840002 2023-10-02 13:02:27,145 DEBUG [RS:1;jenkins-hbase4:46465] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 13:02:27,145 DEBUG [RS:1;jenkins-hbase4:46465] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:27,146 DEBUG [RS:1;jenkins-hbase4:46465] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46465,1696251745531' 2023-10-02 13:02:27,146 DEBUG [RS:1;jenkins-hbase4:46465] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 13:02:27,146 DEBUG [RS:1;jenkins-hbase4:46465] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 13:02:27,147 DEBUG [RS:1;jenkins-hbase4:46465] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 13:02:27,147 DEBUG [RS:1;jenkins-hbase4:46465] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 13:02:27,147 DEBUG [RS:1;jenkins-hbase4:46465] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:27,147 DEBUG [RS:1;jenkins-hbase4:46465] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46465,1696251745531' 2023-10-02 13:02:27,147 DEBUG [RS:1;jenkins-hbase4:46465] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:27,147 INFO [RS:0;jenkins-hbase4:46551] regionserver.Replication(203): jenkins-hbase4.apache.org,46551,1696251745482 started 2023-10-02 13:02:27,147 DEBUG [RS:1;jenkins-hbase4:46465] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:27,148 INFO [RS:2;jenkins-hbase4:33895] regionserver.Replication(203): jenkins-hbase4.apache.org,33895,1696251745577 started 2023-10-02 13:02:27,147 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46551,1696251745482, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46551, sessionid=0x101073ac3840001 2023-10-02 13:02:27,148 INFO [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33895,1696251745577, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33895, sessionid=0x101073ac3840003 2023-10-02 13:02:27,148 DEBUG [RS:0;jenkins-hbase4:46551] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 13:02:27,148 DEBUG [RS:2;jenkins-hbase4:33895] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 13:02:27,149 DEBUG [RS:2;jenkins-hbase4:33895] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:27,148 DEBUG [RS:0;jenkins-hbase4:46551] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:27,149 DEBUG [RS:1;jenkins-hbase4:46465] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 13:02:27,149 DEBUG [RS:0;jenkins-hbase4:46551] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46551,1696251745482' 2023-10-02 13:02:27,150 INFO [RS:1;jenkins-hbase4:46465] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 13:02:27,149 DEBUG [RS:2;jenkins-hbase4:33895] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33895,1696251745577' 2023-10-02 13:02:27,150 DEBUG [RS:2;jenkins-hbase4:33895] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 13:02:27,150 INFO [RS:1;jenkins-hbase4:46465] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 13:02:27,150 DEBUG [RS:0;jenkins-hbase4:46551] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 13:02:27,161 DEBUG [RS:0;jenkins-hbase4:46551] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 13:02:27,161 DEBUG [RS:2;jenkins-hbase4:33895] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 13:02:27,162 DEBUG [RS:0;jenkins-hbase4:46551] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 13:02:27,162 DEBUG [RS:2;jenkins-hbase4:33895] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 13:02:27,162 DEBUG [RS:0;jenkins-hbase4:46551] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 13:02:27,162 DEBUG [RS:2;jenkins-hbase4:33895] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 13:02:27,163 DEBUG [RS:2;jenkins-hbase4:33895] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:27,162 DEBUG [RS:0;jenkins-hbase4:46551] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:27,163 DEBUG [RS:0;jenkins-hbase4:46551] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46551,1696251745482' 2023-10-02 13:02:27,163 DEBUG [RS:2;jenkins-hbase4:33895] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33895,1696251745577' 2023-10-02 13:02:27,163 DEBUG [RS:2;jenkins-hbase4:33895] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:27,163 DEBUG [RS:0;jenkins-hbase4:46551] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:27,163 DEBUG [RS:2;jenkins-hbase4:33895] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:27,163 DEBUG [RS:0;jenkins-hbase4:46551] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:27,164 DEBUG [RS:2;jenkins-hbase4:33895] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 13:02:27,164 DEBUG [RS:0;jenkins-hbase4:46551] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 13:02:27,164 INFO [RS:2;jenkins-hbase4:33895] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 13:02:27,165 INFO [RS:0;jenkins-hbase4:46551] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 13:02:27,166 INFO [RS:0;jenkins-hbase4:46551] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 13:02:27,165 INFO [RS:2;jenkins-hbase4:33895] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 13:02:27,196 DEBUG [jenkins-hbase4:34719] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-02 13:02:27,200 DEBUG [jenkins-hbase4:34719] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 13:02:27,206 DEBUG [jenkins-hbase4:34719] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 13:02:27,207 DEBUG [jenkins-hbase4:34719] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 13:02:27,207 DEBUG [jenkins-hbase4:34719] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 13:02:27,207 DEBUG [jenkins-hbase4:34719] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 13:02:27,210 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46551,1696251745482, state=OPENING 2023-10-02 13:02:27,217 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-02 13:02:27,219 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:02:27,219 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-02 13:02:27,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:02:27,260 INFO [RS:1;jenkins-hbase4:46465] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46465%2C1696251745531, suffix=, logDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,46465,1696251745531, archiveDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/oldWALs, maxLogs=32 2023-10-02 13:02:27,269 INFO [RS:2;jenkins-hbase4:33895] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33895%2C1696251745577, suffix=, logDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,33895,1696251745577, archiveDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/oldWALs, maxLogs=32 2023-10-02 13:02:27,269 INFO [RS:0;jenkins-hbase4:46551] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46551%2C1696251745482, suffix=, logDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,46551,1696251745482, archiveDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/oldWALs, maxLogs=32 2023-10-02 13:02:27,285 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35923,DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01,DISK] 2023-10-02 13:02:27,285 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44641,DS-853f6e0c-4f27-4efc-a86a-66443162dcfe,DISK] 2023-10-02 13:02:27,285 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46113,DS-92dea7b1-31fc-4788-93ce-1baa72084cc0,DISK] 2023-10-02 13:02:27,302 INFO [RS:1;jenkins-hbase4:46465] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,46465,1696251745531/jenkins-hbase4.apache.org%2C46465%2C1696251745531.1696251747262 2023-10-02 13:02:27,308 DEBUG [RS:1;jenkins-hbase4:46465] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35923,DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01,DISK], DatanodeInfoWithStorage[127.0.0.1:46113,DS-92dea7b1-31fc-4788-93ce-1baa72084cc0,DISK], DatanodeInfoWithStorage[127.0.0.1:44641,DS-853f6e0c-4f27-4efc-a86a-66443162dcfe,DISK]] 2023-10-02 13:02:27,320 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44641,DS-853f6e0c-4f27-4efc-a86a-66443162dcfe,DISK] 2023-10-02 13:02:27,320 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44641,DS-853f6e0c-4f27-4efc-a86a-66443162dcfe,DISK] 2023-10-02 13:02:27,321 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35923,DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01,DISK] 2023-10-02 13:02:27,322 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35923,DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01,DISK] 2023-10-02 13:02:27,322 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46113,DS-92dea7b1-31fc-4788-93ce-1baa72084cc0,DISK] 2023-10-02 13:02:27,323 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46113,DS-92dea7b1-31fc-4788-93ce-1baa72084cc0,DISK] 2023-10-02 13:02:27,339 INFO [RS:2;jenkins-hbase4:33895] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,33895,1696251745577/jenkins-hbase4.apache.org%2C33895%2C1696251745577.1696251747270 2023-10-02 13:02:27,339 INFO [RS:0;jenkins-hbase4:46551] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,46551,1696251745482/jenkins-hbase4.apache.org%2C46551%2C1696251745482.1696251747271 2023-10-02 13:02:27,341 DEBUG [RS:2;jenkins-hbase4:33895] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44641,DS-853f6e0c-4f27-4efc-a86a-66443162dcfe,DISK], DatanodeInfoWithStorage[127.0.0.1:46113,DS-92dea7b1-31fc-4788-93ce-1baa72084cc0,DISK], DatanodeInfoWithStorage[127.0.0.1:35923,DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01,DISK]] 2023-10-02 13:02:27,341 DEBUG [RS:0;jenkins-hbase4:46551] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35923,DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01,DISK], DatanodeInfoWithStorage[127.0.0.1:44641,DS-853f6e0c-4f27-4efc-a86a-66443162dcfe,DISK], DatanodeInfoWithStorage[127.0.0.1:46113,DS-92dea7b1-31fc-4788-93ce-1baa72084cc0,DISK]] 2023-10-02 13:02:27,411 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:27,414 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 13:02:27,417 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 13:02:27,432 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-02 13:02:27,433 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 13:02:27,437 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46551%2C1696251745482.meta, suffix=.meta, logDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,46551,1696251745482, archiveDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/oldWALs, maxLogs=32 2023-10-02 13:02:27,465 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44641,DS-853f6e0c-4f27-4efc-a86a-66443162dcfe,DISK] 2023-10-02 13:02:27,466 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46113,DS-92dea7b1-31fc-4788-93ce-1baa72084cc0,DISK] 2023-10-02 13:02:27,472 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35923,DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01,DISK] 2023-10-02 13:02:27,479 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/WALs/jenkins-hbase4.apache.org,46551,1696251745482/jenkins-hbase4.apache.org%2C46551%2C1696251745482.meta.1696251747439.meta 2023-10-02 13:02:27,481 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44641,DS-853f6e0c-4f27-4efc-a86a-66443162dcfe,DISK], DatanodeInfoWithStorage[127.0.0.1:46113,DS-92dea7b1-31fc-4788-93ce-1baa72084cc0,DISK], DatanodeInfoWithStorage[127.0.0.1:35923,DS-f827f7f5-d848-4c3d-9578-ad4baf6e6c01,DISK]] 2023-10-02 13:02:27,481 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-02 13:02:27,482 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-02 13:02:27,483 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:27,484 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-02 13:02:27,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-02 13:02:27,488 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-02 13:02:27,501 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-02 13:02:27,501 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:27,502 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-02 13:02:27,502 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-02 13:02:27,505 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-02 13:02:27,506 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/info 2023-10-02 13:02:27,507 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/info 2023-10-02 13:02:27,507 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-02 13:02:27,508 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:27,508 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-02 13:02:27,510 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/rep_barrier 2023-10-02 13:02:27,510 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/rep_barrier 2023-10-02 13:02:27,511 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-02 13:02:27,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:27,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-02 13:02:27,514 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/table 2023-10-02 13:02:27,514 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/table 2023-10-02 13:02:27,514 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-02 13:02:27,515 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:27,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740 2023-10-02 13:02:27,527 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740 2023-10-02 13:02:27,531 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-02 13:02:27,533 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-02 13:02:27,535 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63193216, jitterRate=-0.05834770202636719}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-02 13:02:27,537 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-02 13:02:27,549 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696251747402 2023-10-02 13:02:27,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-02 13:02:27,570 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-02 13:02:27,570 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46551,1696251745482, state=OPEN 2023-10-02 13:02:27,574 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-02 13:02:27,574 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-02 13:02:27,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-02 13:02:27,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46551,1696251745482 in 351 msec 2023-10-02 13:02:27,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-02 13:02:27,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 556 msec 2023-10-02 13:02:27,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 869 msec 2023-10-02 13:02:27,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696251747591, completionTime=-1 2023-10-02 13:02:27,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-02 13:02:27,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-02 13:02:27,674 DEBUG [hconnection-0x3e7fc64a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:27,677 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:27,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-02 13:02:27,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696251807702 2023-10-02 13:02:27,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696251867703 2023-10-02 13:02:27,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 111 msec 2023-10-02 13:02:27,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34719,1696251744198-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34719,1696251744198-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34719,1696251744198-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34719, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-02 13:02:27,742 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-02 13:02:27,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-02 13:02:27,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 13:02:27,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-02 13:02:27,767 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 13:02:27,771 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 13:02:27,793 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/hbase/namespace/a53f766656abbd282f03313f644ecac4 2023-10-02 13:02:27,795 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/hbase/namespace/a53f766656abbd282f03313f644ecac4 empty. 2023-10-02 13:02:27,796 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/hbase/namespace/a53f766656abbd282f03313f644ecac4 2023-10-02 13:02:27,796 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-02 13:02:27,836 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-02 13:02:27,838 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => a53f766656abbd282f03313f644ecac4, NAME => 'hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:02:27,860 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:27,860 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing a53f766656abbd282f03313f644ecac4, disabling compactions & flushes 2023-10-02 13:02:27,860 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:02:27,860 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:02:27,860 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. after waiting 0 ms 2023-10-02 13:02:27,860 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:02:27,860 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:02:27,860 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for a53f766656abbd282f03313f644ecac4: 2023-10-02 13:02:27,865 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 13:02:27,880 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696251747868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251747868"}]},"ts":"1696251747868"} 2023-10-02 13:02:27,911 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-02 13:02:27,913 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 13:02:27,917 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251747913"}]},"ts":"1696251747913"} 2023-10-02 13:02:27,921 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-02 13:02:27,926 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 13:02:27,927 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 13:02:27,927 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 13:02:27,927 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 13:02:27,927 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 13:02:27,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a53f766656abbd282f03313f644ecac4, ASSIGN}] 2023-10-02 13:02:27,933 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a53f766656abbd282f03313f644ecac4, ASSIGN 2023-10-02 13:02:27,935 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a53f766656abbd282f03313f644ecac4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46551,1696251745482; forceNewPlan=false, retain=false 2023-10-02 13:02:28,088 INFO [jenkins-hbase4:34719] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 13:02:28,089 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a53f766656abbd282f03313f644ecac4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:28,089 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696251748089"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251748089"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251748089"}]},"ts":"1696251748089"} 2023-10-02 13:02:28,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a53f766656abbd282f03313f644ecac4, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:02:28,256 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:02:28,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a53f766656abbd282f03313f644ecac4, NAME => 'hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4.', STARTKEY => '', ENDKEY => ''} 2023-10-02 13:02:28,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. service=AccessControlService 2023-10-02 13:02:28,258 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:28,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a53f766656abbd282f03313f644ecac4 2023-10-02 13:02:28,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:28,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a53f766656abbd282f03313f644ecac4 2023-10-02 13:02:28,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a53f766656abbd282f03313f644ecac4 2023-10-02 13:02:28,262 INFO [StoreOpener-a53f766656abbd282f03313f644ecac4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a53f766656abbd282f03313f644ecac4 2023-10-02 13:02:28,264 DEBUG [StoreOpener-a53f766656abbd282f03313f644ecac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/namespace/a53f766656abbd282f03313f644ecac4/info 2023-10-02 13:02:28,264 DEBUG [StoreOpener-a53f766656abbd282f03313f644ecac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/namespace/a53f766656abbd282f03313f644ecac4/info 2023-10-02 13:02:28,265 INFO [StoreOpener-a53f766656abbd282f03313f644ecac4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a53f766656abbd282f03313f644ecac4 columnFamilyName info 2023-10-02 13:02:28,266 INFO [StoreOpener-a53f766656abbd282f03313f644ecac4-1] regionserver.HStore(310): Store=a53f766656abbd282f03313f644ecac4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:28,268 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/namespace/a53f766656abbd282f03313f644ecac4 2023-10-02 13:02:28,269 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/namespace/a53f766656abbd282f03313f644ecac4 2023-10-02 13:02:28,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a53f766656abbd282f03313f644ecac4 2023-10-02 13:02:28,277 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/namespace/a53f766656abbd282f03313f644ecac4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:02:28,278 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a53f766656abbd282f03313f644ecac4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69955082, jitterRate=0.04241195321083069}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:02:28,278 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a53f766656abbd282f03313f644ecac4: 2023-10-02 13:02:28,280 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4., pid=6, masterSystemTime=1696251748249 2023-10-02 13:02:28,284 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:02:28,284 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:02:28,285 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a53f766656abbd282f03313f644ecac4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:28,285 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696251748284"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251748284"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251748284"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251748284"}]},"ts":"1696251748284"} 2023-10-02 13:02:28,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-02 13:02:28,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a53f766656abbd282f03313f644ecac4, server=jenkins-hbase4.apache.org,46551,1696251745482 in 195 msec 2023-10-02 13:02:28,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-02 13:02:28,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a53f766656abbd282f03313f644ecac4, ASSIGN in 365 msec 2023-10-02 13:02:28,301 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 13:02:28,301 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251748301"}]},"ts":"1696251748301"} 2023-10-02 13:02:28,303 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-02 13:02:28,308 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 13:02:28,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 553 msec 2023-10-02 13:02:28,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-02 13:02:28,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-02 13:02:28,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:02:28,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-02 13:02:28,427 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-02 13:02:28,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-10-02 13:02:28,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-02 13:02:28,459 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-02 13:02:28,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-10-02 13:02:28,481 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-02 13:02:28,484 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-02 13:02:28,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.836sec 2023-10-02 13:02:28,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-02 13:02:28,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-02 13:02:28,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-02 13:02:28,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34719,1696251744198-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-02 13:02:28,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34719,1696251744198-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-02 13:02:28,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 13:02:28,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-02 13:02:28,516 DEBUG [Listener at localhost/39941] zookeeper.ReadOnlyZKClient(139): Connect 0x28ba846e to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:28,519 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 13:02:28,521 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 13:02:28,522 DEBUG [Listener at localhost/39941] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@308037f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:28,524 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:02:28,526 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f empty. 2023-10-02 13:02:28,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-02 13:02:28,529 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:02:28,529 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-02 13:02:28,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 13:02:28,542 DEBUG [hconnection-0x4d1619d6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:28,560 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-02 13:02:28,560 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:28,562 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 46df02ef17bee4370efaec1a2daae64f, NAME => 'hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:02:28,564 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34719,1696251744198 2023-10-02 13:02:28,564 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-02 13:02:28,564 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/test.cache.data in system properties and HBase conf 2023-10-02 13:02:28,564 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop.tmp.dir in system properties and HBase conf 2023-10-02 13:02:28,564 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop.log.dir in system properties and HBase conf 2023-10-02 13:02:28,564 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-02 13:02:28,564 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-02 13:02:28,564 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-02 13:02:28,564 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/nfs.dump.dir in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/java.io.tmpdir in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 13:02:28,565 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-02 13:02:28,566 INFO [Listener at localhost/39941] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-02 13:02:28,592 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:28,592 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 46df02ef17bee4370efaec1a2daae64f, disabling compactions & flushes 2023-10-02 13:02:28,593 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:02:28,593 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:02:28,593 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. after waiting 0 ms 2023-10-02 13:02:28,593 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:02:28,593 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:02:28,593 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 46df02ef17bee4370efaec1a2daae64f: 2023-10-02 13:02:28,601 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 13:02:28,603 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696251748602"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251748602"}]},"ts":"1696251748602"} 2023-10-02 13:02:28,605 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-02 13:02:28,607 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 13:02:28,607 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251748607"}]},"ts":"1696251748607"} 2023-10-02 13:02:28,610 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-02 13:02:28,616 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 13:02:28,617 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 13:02:28,617 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 13:02:28,617 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 13:02:28,617 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 13:02:28,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=46df02ef17bee4370efaec1a2daae64f, ASSIGN}] 2023-10-02 13:02:28,625 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=46df02ef17bee4370efaec1a2daae64f, ASSIGN 2023-10-02 13:02:28,626 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=46df02ef17bee4370efaec1a2daae64f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33895,1696251745577; forceNewPlan=false, retain=false 2023-10-02 13:02:28,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 13:02:28,777 INFO [jenkins-hbase4:34719] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 13:02:28,778 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=46df02ef17bee4370efaec1a2daae64f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:28,778 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696251748778"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251748778"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251748778"}]},"ts":"1696251748778"} 2023-10-02 13:02:28,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 46df02ef17bee4370efaec1a2daae64f, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:02:28,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 13:02:28,938 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:28,938 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 13:02:28,942 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 13:02:28,950 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:02:28,950 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46df02ef17bee4370efaec1a2daae64f, NAME => 'hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f.', STARTKEY => '', ENDKEY => ''} 2023-10-02 13:02:28,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. service=AccessControlService 2023-10-02 13:02:28,951 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:28,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:02:28,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:28,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:02:28,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:02:28,954 INFO [StoreOpener-46df02ef17bee4370efaec1a2daae64f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:02:28,956 DEBUG [StoreOpener-46df02ef17bee4370efaec1a2daae64f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f/l 2023-10-02 13:02:28,956 DEBUG [StoreOpener-46df02ef17bee4370efaec1a2daae64f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f/l 2023-10-02 13:02:28,957 INFO [StoreOpener-46df02ef17bee4370efaec1a2daae64f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46df02ef17bee4370efaec1a2daae64f columnFamilyName l 2023-10-02 13:02:28,958 INFO [StoreOpener-46df02ef17bee4370efaec1a2daae64f-1] regionserver.HStore(310): Store=46df02ef17bee4370efaec1a2daae64f/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:28,960 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:02:28,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:02:28,965 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:02:28,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:02:28,971 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 46df02ef17bee4370efaec1a2daae64f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62096485, jitterRate=-0.07469026744365692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:02:28,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 46df02ef17bee4370efaec1a2daae64f: 2023-10-02 13:02:28,973 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f., pid=11, masterSystemTime=1696251748938 2023-10-02 13:02:28,977 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:02:28,978 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:02:28,979 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=46df02ef17bee4370efaec1a2daae64f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:28,979 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696251748979"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251748979"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251748979"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251748979"}]},"ts":"1696251748979"} 2023-10-02 13:02:28,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-02 13:02:28,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 46df02ef17bee4370efaec1a2daae64f, server=jenkins-hbase4.apache.org,33895,1696251745577 in 201 msec 2023-10-02 13:02:28,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-02 13:02:28,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=46df02ef17bee4370efaec1a2daae64f, ASSIGN in 373 msec 2023-10-02 13:02:28,995 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 13:02:28,996 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251748995"}]},"ts":"1696251748995"} 2023-10-02 13:02:28,998 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-02 13:02:29,005 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 13:02:29,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 492 msec 2023-10-02 13:02:29,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 13:02:29,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-02 13:02:29,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-02 13:02:29,866 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 13:02:30,240 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 13:02:30,247 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37951_jobhistory____.5ytmna/webapp 2023-10-02 13:02:30,427 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-02 13:02:30,427 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-02 13:02:30,427 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 13:02:30,431 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 13:02:30,520 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:30,850 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:31,202 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-02 13:02:31,245 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37951 2023-10-02 13:02:31,365 WARN [Listener at jenkins-hbase4.apache.org/43707] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 13:02:31,655 WARN [Listener at jenkins-hbase4.apache.org/43707] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 13:02:31,656 INFO [Listener at jenkins-hbase4.apache.org/43707] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 13:02:31,663 INFO [Listener at jenkins-hbase4.apache.org/43707] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34113_cluster____.2tokvi/webapp 2023-10-02 13:02:31,735 INFO [Listener at jenkins-hbase4.apache.org/43707] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 13:02:31,735 INFO [Listener at jenkins-hbase4.apache.org/43707] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-02 13:02:31,736 INFO [Listener at jenkins-hbase4.apache.org/43707] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 13:02:31,736 INFO [Listener at jenkins-hbase4.apache.org/43707] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 13:02:31,746 INFO [Listener at jenkins-hbase4.apache.org/43707] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:31,971 INFO [Listener at jenkins-hbase4.apache.org/43707] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:32,053 INFO [Listener at jenkins-hbase4.apache.org/43707] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:32,064 INFO [Listener at jenkins-hbase4.apache.org/43707] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34113 2023-10-02 13:02:32,575 WARN [Listener at jenkins-hbase4.apache.org/36239] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 13:02:32,604 WARN [Listener at jenkins-hbase4.apache.org/36239] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 13:02:32,605 INFO [Listener at jenkins-hbase4.apache.org/36239] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 13:02:32,613 INFO [Listener at jenkins-hbase4.apache.org/36239] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36979_node____2hc446/webapp 2023-10-02 13:02:32,666 INFO [Listener at jenkins-hbase4.apache.org/36239] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-02 13:02:32,667 INFO [Listener at jenkins-hbase4.apache.org/36239] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 13:02:32,667 INFO [Listener at jenkins-hbase4.apache.org/36239] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 13:02:32,667 INFO [Listener at jenkins-hbase4.apache.org/36239] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 13:02:32,677 INFO [Listener at jenkins-hbase4.apache.org/36239] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:32,701 INFO [Listener at jenkins-hbase4.apache.org/36239] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:32,764 INFO [Listener at jenkins-hbase4.apache.org/36239] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:32,774 INFO [Listener at jenkins-hbase4.apache.org/36239] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36979 2023-10-02 13:02:32,944 WARN [Listener at jenkins-hbase4.apache.org/39417] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 13:02:32,950 WARN [Listener at jenkins-hbase4.apache.org/39417] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 13:02:32,950 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 13:02:32,959 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41929_node____37dujl/webapp 2023-10-02 13:02:33,010 INFO [Listener at jenkins-hbase4.apache.org/39417] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-02 13:02:33,010 INFO [Listener at jenkins-hbase4.apache.org/39417] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 13:02:33,010 INFO [Listener at jenkins-hbase4.apache.org/39417] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 13:02:33,010 INFO [Listener at jenkins-hbase4.apache.org/39417] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 13:02:33,019 INFO [Listener at jenkins-hbase4.apache.org/39417] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:33,038 INFO [Listener at jenkins-hbase4.apache.org/39417] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:33,059 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 13:02:33,182 INFO [Listener at jenkins-hbase4.apache.org/39417] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 13:02:33,197 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41929 2023-10-02 13:02:33,235 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-02 13:02:33,237 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:02:33,309 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-02 13:02:33,311 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-02 13:02:33,313 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=192, ProcessCount=165, AvailableMemoryMB=2443 2023-10-02 13:02:33,313 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-10-02 13:02:33,313 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-02 13:02:33,329 DEBUG [Listener at jenkins-hbase4.apache.org/39417] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-02 13:02:33,334 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-02 13:02:33,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 13:02:33,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-02 13:02:33,347 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 13:02:33,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-02 13:02:33,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 13:02:33,350 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 13:02:33,355 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:33,357 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a empty. 2023-10-02 13:02:33,357 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:33,359 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:33,359 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c empty. 2023-10-02 13:02:33,361 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:33,361 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-02 13:02:33,396 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-02 13:02:33,398 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => eabad7692bdd57c902a8ae3944b2940a, NAME => 'testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:02:33,399 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4408b7c6a62d24e42caf620ca1a6d12c, NAME => 'testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:02:33,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:33,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing eabad7692bdd57c902a8ae3944b2940a, disabling compactions & flushes 2023-10-02 13:02:33,441 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:33,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:33,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. after waiting 0 ms 2023-10-02 13:02:33,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:33,441 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:33,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for eabad7692bdd57c902a8ae3944b2940a: 2023-10-02 13:02:33,442 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:33,443 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 4408b7c6a62d24e42caf620ca1a6d12c, disabling compactions & flushes 2023-10-02 13:02:33,443 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:33,443 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:33,443 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. after waiting 0 ms 2023-10-02 13:02:33,443 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:33,443 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:33,443 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 4408b7c6a62d24e42caf620ca1a6d12c: 2023-10-02 13:02:33,447 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 13:02:33,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696251753448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251753448"}]},"ts":"1696251753448"} 2023-10-02 13:02:33,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696251753448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251753448"}]},"ts":"1696251753448"} 2023-10-02 13:02:33,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 13:02:33,499 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 13:02:33,501 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 13:02:33,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251753501"}]},"ts":"1696251753501"} 2023-10-02 13:02:33,503 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-02 13:02:33,509 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 13:02:33,511 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 13:02:33,511 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 13:02:33,511 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 13:02:33,511 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 13:02:33,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eabad7692bdd57c902a8ae3944b2940a, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4408b7c6a62d24e42caf620ca1a6d12c, ASSIGN}] 2023-10-02 13:02:33,515 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eabad7692bdd57c902a8ae3944b2940a, ASSIGN 2023-10-02 13:02:33,515 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4408b7c6a62d24e42caf620ca1a6d12c, ASSIGN 2023-10-02 13:02:33,517 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4408b7c6a62d24e42caf620ca1a6d12c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46465,1696251745531; forceNewPlan=false, retain=false 2023-10-02 13:02:33,517 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eabad7692bdd57c902a8ae3944b2940a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33895,1696251745577; forceNewPlan=false, retain=false 2023-10-02 13:02:33,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 13:02:33,667 INFO [jenkins-hbase4:34719] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 13:02:33,670 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=eabad7692bdd57c902a8ae3944b2940a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:33,670 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4408b7c6a62d24e42caf620ca1a6d12c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:33,671 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696251753670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251753670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251753670"}]},"ts":"1696251753670"} 2023-10-02 13:02:33,671 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696251753670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251753670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251753670"}]},"ts":"1696251753670"} 2023-10-02 13:02:33,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure eabad7692bdd57c902a8ae3944b2940a, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:02:33,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 4408b7c6a62d24e42caf620ca1a6d12c, server=jenkins-hbase4.apache.org,46465,1696251745531}] 2023-10-02 13:02:33,830 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:33,831 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 13:02:33,834 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 13:02:33,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:33,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eabad7692bdd57c902a8ae3944b2940a, NAME => 'testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 13:02:33,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. service=AccessControlService 2023-10-02 13:02:33,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:33,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:33,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:33,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:33,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:33,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:33,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4408b7c6a62d24e42caf620ca1a6d12c, NAME => 'testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 13:02:33,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. service=AccessControlService 2023-10-02 13:02:33,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:33,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:33,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:33,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:33,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:33,845 INFO [StoreOpener-eabad7692bdd57c902a8ae3944b2940a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:33,847 INFO [StoreOpener-4408b7c6a62d24e42caf620ca1a6d12c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:33,848 DEBUG [StoreOpener-eabad7692bdd57c902a8ae3944b2940a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/cf 2023-10-02 13:02:33,848 DEBUG [StoreOpener-eabad7692bdd57c902a8ae3944b2940a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/cf 2023-10-02 13:02:33,849 DEBUG [StoreOpener-4408b7c6a62d24e42caf620ca1a6d12c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/cf 2023-10-02 13:02:33,849 DEBUG [StoreOpener-4408b7c6a62d24e42caf620ca1a6d12c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/cf 2023-10-02 13:02:33,853 INFO [StoreOpener-eabad7692bdd57c902a8ae3944b2940a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eabad7692bdd57c902a8ae3944b2940a columnFamilyName cf 2023-10-02 13:02:33,853 INFO [StoreOpener-4408b7c6a62d24e42caf620ca1a6d12c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4408b7c6a62d24e42caf620ca1a6d12c columnFamilyName cf 2023-10-02 13:02:33,855 INFO [StoreOpener-4408b7c6a62d24e42caf620ca1a6d12c-1] regionserver.HStore(310): Store=4408b7c6a62d24e42caf620ca1a6d12c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:33,855 INFO [StoreOpener-eabad7692bdd57c902a8ae3944b2940a-1] regionserver.HStore(310): Store=eabad7692bdd57c902a8ae3944b2940a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:33,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:33,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:33,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:33,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:33,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:33,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:33,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:02:33,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:02:33,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eabad7692bdd57c902a8ae3944b2940a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64699412, jitterRate=-0.03590363264083862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:02:33,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eabad7692bdd57c902a8ae3944b2940a: 2023-10-02 13:02:33,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4408b7c6a62d24e42caf620ca1a6d12c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61525064, jitterRate=-0.08320510387420654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:02:33,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4408b7c6a62d24e42caf620ca1a6d12c: 2023-10-02 13:02:33,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a., pid=15, masterSystemTime=1696251753826 2023-10-02 13:02:33,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c., pid=16, masterSystemTime=1696251753830 2023-10-02 13:02:33,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:33,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:33,879 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=eabad7692bdd57c902a8ae3944b2940a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:33,880 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696251753879"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251753879"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251753879"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251753879"}]},"ts":"1696251753879"} 2023-10-02 13:02:33,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:33,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:33,881 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4408b7c6a62d24e42caf620ca1a6d12c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:33,884 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696251753881"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251753881"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251753881"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251753881"}]},"ts":"1696251753881"} 2023-10-02 13:02:33,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-02 13:02:33,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure eabad7692bdd57c902a8ae3944b2940a, server=jenkins-hbase4.apache.org,33895,1696251745577 in 213 msec 2023-10-02 13:02:33,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-02 13:02:33,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 4408b7c6a62d24e42caf620ca1a6d12c, server=jenkins-hbase4.apache.org,46465,1696251745531 in 213 msec 2023-10-02 13:02:33,894 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eabad7692bdd57c902a8ae3944b2940a, ASSIGN in 380 msec 2023-10-02 13:02:33,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-02 13:02:33,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4408b7c6a62d24e42caf620ca1a6d12c, ASSIGN in 383 msec 2023-10-02 13:02:33,897 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 13:02:33,898 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251753897"}]},"ts":"1696251753897"} 2023-10-02 13:02:33,899 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-02 13:02:33,903 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 13:02:33,908 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-02 13:02:33,914 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:33,917 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:33,921 DEBUG [hconnection-0x6364a7ff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:33,924 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-10-02 13:02:33,932 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 13:02:33,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 13:02:33,964 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:33,964 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:33,964 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:33,964 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:33,964 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:02:33,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 13:02:33,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 13:02:33,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 13:02:33,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 13:02:33,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 632 msec 2023-10-02 13:02:34,364 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:02:34,365 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-02 13:02:34,365 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:02:34,365 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-02 13:02:34,365 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-02 13:02:34,366 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-02 13:02:34,366 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:02:34,366 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-02 13:02:34,366 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-02 13:02:34,366 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-02 13:02:34,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 13:02:34,461 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-02 13:02:34,465 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-02 13:02:34,466 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:34,469 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:02:34,493 DEBUG [hconnection-0x4d1619d6-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:34,498 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:34,501 DEBUG [hconnection-0x4d1619d6-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:34,508 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:34,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 13:02:34,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251754523 (current time:1696251754523). 2023-10-02 13:02:34,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:02:34,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x564045ba to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:34,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9d9f374, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:34,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:34,536 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:34,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x564045ba to 127.0.0.1:55009 2023-10-02 13:02:34,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:02:34,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x1c2076b2 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:34,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52a582cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:34,550 DEBUG [hconnection-0x30f351df-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:34,551 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:34,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:34,559 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:34,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c2076b2 to 127.0.0.1:55009 2023-10-02 13:02:34,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:02:34,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 13:02:34,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:02:34,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 13:02:34,599 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:02:34,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 13:02:34,625 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 13:02:34,627 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696252354627 2023-10-02 13:02:34,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 13:02:34,627 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-02 13:02:34,630 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 13:02:34,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 13:02:34,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-10-02 13:02:34,633 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 13:02:34,634 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696252354634 2023-10-02 13:02:34,635 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:02:34,635 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:02:34,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,665 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-02 13:02:34,665 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:34,667 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-02 13:02:34,667 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-02 13:02:34,668 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,668 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,673 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:34,673 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:34,673 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:34,673 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:34,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:34,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:34,674 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:34,674 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,674 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,675 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:02:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 13:02:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 13:02:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 13:02:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 13:02:34,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 13:02:34,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 13:02:34,681 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,681 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,681 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,684 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 13:02:34,684 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 13:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 13:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:34,685 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 13:02:34,686 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 13:02:34,686 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 13:02:34,684 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:34,686 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 13:02:34,687 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 13:02:34,687 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 13:02:34,686 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 13:02:34,687 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 13:02:34,687 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 13:02:34,690 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:34,691 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,691 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,691 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,691 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,691 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:34,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:34,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-02 13:02:34,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b4d667d[Count = 1] remaining members to acquire global barrier 2023-10-02 13:02:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:34,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-02 13:02:34,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b4d667d[Count = 0] remaining members to acquire global barrier 2023-10-02 13:02:34,698 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-02 13:02:34,698 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,701 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,701 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,701 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,701 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,701 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 13:02:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,702 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,702 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:02:34,703 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:02:34,703 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:34,703 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:02:34,703 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. started... 2023-10-02 13:02:34,703 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 13:02:34,704 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:02:34,704 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:02:34,704 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:34,704 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. started... 2023-10-02 13:02:34,705 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 13:02:34,705 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 13:02:34,705 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:02:34,707 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eabad7692bdd57c902a8ae3944b2940a: 2023-10-02 13:02:34,707 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4408b7c6a62d24e42caf620ca1a6d12c: 2023-10-02 13:02:34,708 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 13:02:34,709 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:34,709 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 13:02:34,710 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,710 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,717 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:02:34,717 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:02:34,720 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:02:34,720 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:02:34,740 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:02:34,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 13:02:34,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:02:34,766 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. completed. 2023-10-02 13:02:34,766 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:34,766 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. completed. 2023-10-02 13:02:34,766 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:34,767 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:02:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:02:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:02:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:02:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:02:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 13:02:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 13:02:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:02:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:02:34,770 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,770 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 13:02:34,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:34,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:34,770 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:34,770 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 13:02:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 13:02:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:34,772 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 13:02:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46465,1696251745531': 2023-10-02 13:02:34,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-02 13:02:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:34,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33895,1696251745577': 2023-10-02 13:02:34,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-02 13:02:34,782 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-02 13:02:34,782 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:02:34,782 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:02:34,782 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,782 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:02:34,785 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,785 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,785 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:34,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,785 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,785 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:34,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,785 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:34,786 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,786 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:34,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:34,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:34,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:34,787 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:34,788 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:34,790 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,791 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,791 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,804 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,804 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,804 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:34,804 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,804 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,804 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:34,804 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:34,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:34,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:34,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:34,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-02 13:02:34,805 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:34,805 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:34,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,805 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:34,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:02:34,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:34,805 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:34,805 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:34,805 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:34,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:34,806 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:34,807 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:34,807 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:34,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:34,807 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:34,807 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 13:02:34,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:34,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:34,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,884 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-02 13:02:34,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,885 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:34,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696251754627Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696251754824 (+197 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696251754824Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696251754824Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696251754839 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696251754870 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696251754884 (+14 ms) 2023-10-02 13:02:34,888 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 13:02:34,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 259 msec 2023-10-02 13:02:34,967 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:02:34,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 13:02:34,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:02:34,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33895] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:02:34,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46465] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:02:34,990 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-02 13:02:34,990 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:34,991 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:02:35,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 13:02:35,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251755007 (current time:1696251755007). 2023-10-02 13:02:35,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:02:35,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x2615f46d to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:35,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a94c6db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:35,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:35,020 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:35,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2615f46d to 127.0.0.1:55009 2023-10-02 13:02:35,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:02:35,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x40d1d518 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:35,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@496ee7f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:35,029 DEBUG [hconnection-0x5550421b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:35,032 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:35,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:35,040 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:35,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40d1d518 to 127.0.0.1:55009 2023-10-02 13:02:35,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:02:35,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 13:02:35,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:02:35,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 13:02:35,046 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:02:35,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 13:02:35,049 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 13:02:35,051 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696252355051 2023-10-02 13:02:35,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-02 13:02:35,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 13:02:35,052 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:02:35,052 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:02:35,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 13:02:35,054 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 13:02:35,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-10-02 13:02:35,056 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 13:02:35,057 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696252355057 2023-10-02 13:02:35,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-02 13:02:35,076 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-02 13:02:35,076 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:35,077 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-02 13:02:35,077 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-02 13:02:35,077 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,077 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,079 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:35,079 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:35,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:35,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:35,080 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,079 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:35,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,080 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,080 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,081 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,081 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:02:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 13:02:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 13:02:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 13:02:35,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 13:02:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 13:02:35,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 13:02:35,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 13:02:35,082 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 13:02:35,082 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 13:02:35,082 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:35,082 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 13:02:35,083 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 13:02:35,082 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:35,083 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 13:02:35,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 13:02:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 13:02:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 13:02:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 13:02:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 13:02:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 13:02:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:35,085 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 13:02:35,085 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 13:02:35,085 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 13:02:35,088 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,088 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,088 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:35,089 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:35,089 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,089 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,089 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,089 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:35,089 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:35,089 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:35,089 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:35,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 13:02:35,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:35,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-02 13:02:35,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74c31c8d[Count = 1] remaining members to acquire global barrier 2023-10-02 13:02:35,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 13:02:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:35,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-02 13:02:35,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74c31c8d[Count = 0] remaining members to acquire global barrier 2023-10-02 13:02:35,094 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-02 13:02:35,094 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,099 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,099 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,099 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,099 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 13:02:35,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,099 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,099 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:02:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:02:35,099 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 13:02:35,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,100 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 13:02:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:02:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 13:02:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:02:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:02:35,100 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:35,100 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. started... 2023-10-02 13:02:35,100 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,100 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:02:35,100 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. started... 2023-10-02 13:02:35,100 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4408b7c6a62d24e42caf620ca1a6d12c 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-10-02 13:02:35,101 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2745): Flushing eabad7692bdd57c902a8ae3944b2940a 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-10-02 13:02:35,103 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 13:02:35,103 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:35,103 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 13:02:35,152 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:02:35,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 13:02:35,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:02:35,155 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:02:35,240 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310028ef1ccecf7f8484a8a663f69eb0a3792 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310028ef1ccecf7f8484a8a663f69eb0a3792 2023-10-02 13:02:35,240 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100283cf8d0375594cfc9f460258b519c257 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100283cf8d0375594cfc9f460258b519c257 2023-10-02 13:02:35,274 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/.tmp/cf/3b4fc37b9117457fbb57c2f4bf066597 2023-10-02 13:02:35,277 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/.tmp/cf/826ecb265bcb49b181227cebb05dcec8 2023-10-02 13:02:35,288 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/.tmp/cf/826ecb265bcb49b181227cebb05dcec8 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/cf/826ecb265bcb49b181227cebb05dcec8 2023-10-02 13:02:35,289 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/.tmp/cf/3b4fc37b9117457fbb57c2f4bf066597 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/cf/3b4fc37b9117457fbb57c2f4bf066597 2023-10-02 13:02:35,298 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/cf/3b4fc37b9117457fbb57c2f4bf066597, entries=43, sequenceid=6, filesize=12.1 K 2023-10-02 13:02:35,298 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/cf/826ecb265bcb49b181227cebb05dcec8, entries=7, sequenceid=6, filesize=6.1 K 2023-10-02 13:02:35,303 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for eabad7692bdd57c902a8ae3944b2940a in 202ms, sequenceid=6, compaction requested=false 2023-10-02 13:02:35,303 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 4408b7c6a62d24e42caf620ca1a6d12c in 202ms, sequenceid=6, compaction requested=false 2023-10-02 13:02:35,303 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-02 13:02:35,303 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-02 13:02:35,305 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eabad7692bdd57c902a8ae3944b2940a: 2023-10-02 13:02:35,305 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4408b7c6a62d24e42caf620ca1a6d12c: 2023-10-02 13:02:35,306 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 13:02:35,306 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:02:35,306 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/cf/826ecb265bcb49b181227cebb05dcec8] hfiles 2023-10-02 13:02:35,306 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 13:02:35,306 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/cf/826ecb265bcb49b181227cebb05dcec8 for snapshot=snaptb0-testExportWithTargetName 2023-10-02 13:02:35,306 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:02:35,306 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/cf/3b4fc37b9117457fbb57c2f4bf066597] hfiles 2023-10-02 13:02:35,306 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/cf/3b4fc37b9117457fbb57c2f4bf066597 for snapshot=snaptb0-testExportWithTargetName 2023-10-02 13:02:35,335 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. completed. 2023-10-02 13:02:35,336 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. completed. 2023-10-02 13:02:35,336 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:35,336 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:02:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:02:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:02:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:02:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 13:02:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:02:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 13:02:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:02:35,338 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,338 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 13:02:35,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:35,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:35,339 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:35,339 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 13:02:35,340 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,340 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 13:02:35,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:35,340 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:35,340 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 13:02:35,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:35,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 13:02:35,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 13:02:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46465,1696251745531': 2023-10-02 13:02:35,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-02 13:02:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 13:02:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:35,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 13:02:35,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33895,1696251745577': 2023-10-02 13:02:35,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-02 13:02:35,350 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-02 13:02:35,350 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:02:35,350 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:02:35,350 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-02 13:02:35,350 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:02:35,353 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,353 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,353 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:35,353 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,353 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:35,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:35,353 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,354 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:35,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:35,354 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:35,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:35,354 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 13:02:35,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,355 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,355 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:02:35,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:35,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 13:02:35,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 13:02:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:02:35,357 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 13:02:35,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,358 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:35,359 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 13:02:35,360 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,374 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,374 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:35,374 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:35,374 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:35,374 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:35,374 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:35,374 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:35,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-02 13:02:35,375 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:35,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-02 13:02:35,374 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:35,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:35,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:35,374 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:35,375 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 13:02:35,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:35,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:35,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:02:35,376 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:35,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:35,376 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:35,376 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:35,377 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:35,377 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:35,377 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,377 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100283cf8d0375594cfc9f460258b519c257, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310028ef1ccecf7f8484a8a663f69eb0a3792] mob files 2023-10-02 13:02:35,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100283cf8d0375594cfc9f460258b519c257 2023-10-02 13:02:35,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310028ef1ccecf7f8484a8a663f69eb0a3792 2023-10-02 13:02:35,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-02 13:02:35,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,436 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-02 13:02:35,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,437 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 13:02:35,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696251755051Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696251755398 (+347 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696251755398Loading Region manifests for snaptb0-testExportWithTargetName at 1696251755398Writing data manifest for snaptb0-testExportWithTargetName at 1696251755405 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696251755424 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696251755436 (+12 ms) 2023-10-02 13:02:35,439 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 13:02:35,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 387 msec 2023-10-02 13:02:35,657 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:02:35,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 13:02:35,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:02:35,661 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251755661 2023-10-02 13:02:35,662 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35861, tgtDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251755661, rawTgtDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251755661, srcFsUri=hdfs://localhost:35861, srcDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:02:35,701 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:02:35,702 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1246556863_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251755661, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251755661/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-02 13:02:35,702 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c, snapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-02 13:02:35,720 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251755661/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-02 13:02:35,797 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:35,798 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:35,798 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:35,799 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:36,747 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-4504143755362026235.jar 2023-10-02 13:02:36,748 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:36,749 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:36,817 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-3902302391415228762.jar 2023-10-02 13:02:36,818 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:36,818 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:36,819 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:36,819 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:36,820 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:36,820 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:36,820 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 13:02:36,821 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 13:02:36,821 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 13:02:36,822 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 13:02:36,822 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 13:02:36,823 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 13:02:36,823 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 13:02:36,824 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 13:02:36,824 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 13:02:36,825 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 13:02:36,828 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:02:36,829 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:02:36,829 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:02:36,829 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:02:36,830 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:02:36,830 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:02:36,831 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:02:37,636 WARN [Listener at jenkins-hbase4.apache.org/39417] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 13:02:37,641 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-02 13:02:37,650 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-02 13:02:38,111 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:02:38,113 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:02:38,384 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0001_000001 (auth:SIMPLE) 2023-10-02 13:02:39,348 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 13:02:42,834 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0001_000001 (auth:SIMPLE) 2023-10-02 13:02:45,099 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0001_000001 (auth:SIMPLE) 2023-10-02 13:02:48,582 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0001_000001 (auth:SIMPLE) 2023-10-02 13:02:50,534 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 13:02:50,538 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 13:02:50,551 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-02 13:02:50,551 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 13:02:50,552 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 13:02:50,552 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-02 13:02:50,553 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-02 13:02:50,553 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-02 13:02:50,553 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251755661/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251755661/.hbase-snapshot/testExportWithTargetName 2023-10-02 13:02:50,554 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251755661/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-02 13:02:50,554 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251755661/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-02 13:02:50,566 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-02 13:02:50,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-02 13:02:50,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-02 13:02:50,590 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251770590"}]},"ts":"1696251770590"} 2023-10-02 13:02:50,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 13:02:50,592 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-02 13:02:50,595 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-02 13:02:50,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eabad7692bdd57c902a8ae3944b2940a, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4408b7c6a62d24e42caf620ca1a6d12c, UNASSIGN}] 2023-10-02 13:02:50,600 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eabad7692bdd57c902a8ae3944b2940a, UNASSIGN 2023-10-02 13:02:50,600 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4408b7c6a62d24e42caf620ca1a6d12c, UNASSIGN 2023-10-02 13:02:50,601 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=eabad7692bdd57c902a8ae3944b2940a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:50,601 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4408b7c6a62d24e42caf620ca1a6d12c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:50,601 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696251770601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251770601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251770601"}]},"ts":"1696251770601"} 2023-10-02 13:02:50,601 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696251770601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251770601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251770601"}]},"ts":"1696251770601"} 2023-10-02 13:02:50,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure eabad7692bdd57c902a8ae3944b2940a, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:02:50,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 4408b7c6a62d24e42caf620ca1a6d12c, server=jenkins-hbase4.apache.org,46465,1696251745531}] 2023-10-02 13:02:50,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 13:02:50,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:50,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:50,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eabad7692bdd57c902a8ae3944b2940a, disabling compactions & flushes 2023-10-02 13:02:50,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4408b7c6a62d24e42caf620ca1a6d12c, disabling compactions & flushes 2023-10-02 13:02:50,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:50,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:50,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:50,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:50,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. after waiting 0 ms 2023-10-02 13:02:50,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. after waiting 0 ms 2023-10-02 13:02:50,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:50,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:50,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:02:50,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:02:50,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:02:50,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:02:50,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a. 2023-10-02 13:02:50,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eabad7692bdd57c902a8ae3944b2940a: 2023-10-02 13:02:50,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c. 2023-10-02 13:02:50,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4408b7c6a62d24e42caf620ca1a6d12c: 2023-10-02 13:02:50,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:50,790 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=eabad7692bdd57c902a8ae3944b2940a, regionState=CLOSED 2023-10-02 13:02:50,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:50,791 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696251770790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251770790"}]},"ts":"1696251770790"} 2023-10-02 13:02:50,791 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4408b7c6a62d24e42caf620ca1a6d12c, regionState=CLOSED 2023-10-02 13:02:50,792 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696251770791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251770791"}]},"ts":"1696251770791"} 2023-10-02 13:02:50,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-02 13:02:50,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure eabad7692bdd57c902a8ae3944b2940a, server=jenkins-hbase4.apache.org,33895,1696251745577 in 189 msec 2023-10-02 13:02:50,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-02 13:02:50,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 4408b7c6a62d24e42caf620ca1a6d12c, server=jenkins-hbase4.apache.org,46465,1696251745531 in 188 msec 2023-10-02 13:02:50,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=eabad7692bdd57c902a8ae3944b2940a, UNASSIGN in 199 msec 2023-10-02 13:02:50,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-02 13:02:50,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4408b7c6a62d24e42caf620ca1a6d12c, UNASSIGN in 200 msec 2023-10-02 13:02:50,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251770800"}]},"ts":"1696251770800"} 2023-10-02 13:02:50,802 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-02 13:02:50,803 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-02 13:02:50,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 227 msec 2023-10-02 13:02:50,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 13:02:50,895 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-02 13:02:50,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-02 13:02:50,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 13:02:50,912 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 13:02:50,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-02 13:02:50,914 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 13:02:50,917 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-02 13:02:50,920 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 13:02:50,920 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 13:02:50,921 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:50,920 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 13:02:50,921 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:50,920 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 13:02:50,922 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-02 13:02:50,925 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/recovered.edits] 2023-10-02 13:02:50,925 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/recovered.edits] 2023-10-02 13:02:50,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 13:02:50,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:50,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:50,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-02 13:02:50,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-02 13:02:50,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-02 13:02:50,926 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 13:02:50,927 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:50,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:50,926 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 13:02:50,926 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 13:02:50,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-02 13:02:50,937 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/cf/3b4fc37b9117457fbb57c2f4bf066597 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/cf/3b4fc37b9117457fbb57c2f4bf066597 2023-10-02 13:02:50,937 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/cf/826ecb265bcb49b181227cebb05dcec8 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/cf/826ecb265bcb49b181227cebb05dcec8 2023-10-02 13:02:50,942 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a/recovered.edits/9.seqid 2023-10-02 13:02:50,942 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c/recovered.edits/9.seqid 2023-10-02 13:02:50,943 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/eabad7692bdd57c902a8ae3944b2940a 2023-10-02 13:02:50,943 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportWithTargetName/4408b7c6a62d24e42caf620ca1a6d12c 2023-10-02 13:02:50,943 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-02 13:02:50,944 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-02 13:02:50,945 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-02 13:02:50,950 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100283cf8d0375594cfc9f460258b519c257 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100283cf8d0375594cfc9f460258b519c257 2023-10-02 13:02:50,951 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310028ef1ccecf7f8484a8a663f69eb0a3792 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310028ef1ccecf7f8484a8a663f69eb0a3792 2023-10-02 13:02:50,952 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-02 13:02:50,955 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 13:02:50,976 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-02 13:02:50,980 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-02 13:02:50,981 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 13:02:50,981 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-02 13:02:50,982 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251770982"}]},"ts":"9223372036854775807"} 2023-10-02 13:02:50,982 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251770982"}]},"ts":"9223372036854775807"} 2023-10-02 13:02:50,984 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 13:02:50,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => eabad7692bdd57c902a8ae3944b2940a, NAME => 'testtb-testExportWithTargetName,,1696251753341.eabad7692bdd57c902a8ae3944b2940a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4408b7c6a62d24e42caf620ca1a6d12c, NAME => 'testtb-testExportWithTargetName,1,1696251753341.4408b7c6a62d24e42caf620ca1a6d12c.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 13:02:50,984 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-02 13:02:50,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696251770984"}]},"ts":"9223372036854775807"} 2023-10-02 13:02:50,986 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-02 13:02:50,989 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 13:02:50,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 86 msec 2023-10-02 13:02:51,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-02 13:02:51,034 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-02 13:02:51,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-02 13:02:51,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-02 13:02:51,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-02 13:02:51,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-02 13:02:51,100 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=756 (was 705) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase4.apache.org/172.31.14.131:34557 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-82816073_1 at /127.0.0.1:46364 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:46398 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-82816073_1 at /127.0.0.1:36142 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:36156 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase4.apache.org/172.31.14.131:36239 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:50816 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase4.apache.org/172.31.14.131:37311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=939 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=225 (was 192) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=1617 (was 2443) 2023-10-02 13:02:51,100 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-10-02 13:02:51,121 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=225, ProcessCount=168, AvailableMemoryMB=1616 2023-10-02 13:02:51,121 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-10-02 13:02:51,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 13:02:51,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-02 13:02:51,128 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 13:02:51,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-02 13:02:51,132 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 13:02:51,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 13:02:51,135 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:02:51,135 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:02:51,136 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49 empty. 2023-10-02 13:02:51,136 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273 empty. 2023-10-02 13:02:51,136 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:02:51,136 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:02:51,137 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-02 13:02:51,153 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-02 13:02:51,155 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0a2d45e25ad8772327d73e1a15c79273, NAME => 'testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:02:51,155 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fde83397e93ddec5368d04ff53b46f49, NAME => 'testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:02:51,189 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:51,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fde83397e93ddec5368d04ff53b46f49, disabling compactions & flushes 2023-10-02 13:02:51,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:51,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:51,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. after waiting 0 ms 2023-10-02 13:02:51,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:51,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:51,190 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fde83397e93ddec5368d04ff53b46f49: 2023-10-02 13:02:51,195 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:51,197 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0a2d45e25ad8772327d73e1a15c79273, disabling compactions & flushes 2023-10-02 13:02:51,197 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:51,197 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:51,197 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. after waiting 0 ms 2023-10-02 13:02:51,197 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:51,197 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:51,197 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0a2d45e25ad8772327d73e1a15c79273: 2023-10-02 13:02:51,200 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 13:02:51,201 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696251771201"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251771201"}]},"ts":"1696251771201"} 2023-10-02 13:02:51,201 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696251771201"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251771201"}]},"ts":"1696251771201"} 2023-10-02 13:02:51,204 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 13:02:51,205 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 13:02:51,205 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251771205"}]},"ts":"1696251771205"} 2023-10-02 13:02:51,207 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-02 13:02:51,210 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 13:02:51,211 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 13:02:51,211 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 13:02:51,211 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 13:02:51,211 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 13:02:51,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0a2d45e25ad8772327d73e1a15c79273, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fde83397e93ddec5368d04ff53b46f49, ASSIGN}] 2023-10-02 13:02:51,215 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0a2d45e25ad8772327d73e1a15c79273, ASSIGN 2023-10-02 13:02:51,215 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fde83397e93ddec5368d04ff53b46f49, ASSIGN 2023-10-02 13:02:51,222 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0a2d45e25ad8772327d73e1a15c79273, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46465,1696251745531; forceNewPlan=false, retain=false 2023-10-02 13:02:51,222 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fde83397e93ddec5368d04ff53b46f49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33895,1696251745577; forceNewPlan=false, retain=false 2023-10-02 13:02:51,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 13:02:51,372 INFO [jenkins-hbase4:34719] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 13:02:51,375 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0a2d45e25ad8772327d73e1a15c79273, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,375 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fde83397e93ddec5368d04ff53b46f49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,375 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696251771374"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251771374"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251771374"}]},"ts":"1696251771374"} 2023-10-02 13:02:51,375 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696251771374"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251771374"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251771374"}]},"ts":"1696251771374"} 2023-10-02 13:02:51,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 0a2d45e25ad8772327d73e1a15c79273, server=jenkins-hbase4.apache.org,46465,1696251745531}] 2023-10-02 13:02:51,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure fde83397e93ddec5368d04ff53b46f49, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:02:51,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 13:02:51,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:51,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a2d45e25ad8772327d73e1a15c79273, NAME => 'testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 13:02:51,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. service=AccessControlService 2023-10-02 13:02:51,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:51,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:51,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fde83397e93ddec5368d04ff53b46f49, NAME => 'testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 13:02:51,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:02:51,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:51,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:02:51,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:02:51,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. service=AccessControlService 2023-10-02 13:02:51,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:02:51,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:02:51,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:02:51,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:02:51,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:02:51,537 INFO [StoreOpener-0a2d45e25ad8772327d73e1a15c79273-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:02:51,538 INFO [StoreOpener-fde83397e93ddec5368d04ff53b46f49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:02:51,539 DEBUG [StoreOpener-0a2d45e25ad8772327d73e1a15c79273-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/cf 2023-10-02 13:02:51,539 DEBUG [StoreOpener-0a2d45e25ad8772327d73e1a15c79273-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/cf 2023-10-02 13:02:51,539 INFO [StoreOpener-0a2d45e25ad8772327d73e1a15c79273-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a2d45e25ad8772327d73e1a15c79273 columnFamilyName cf 2023-10-02 13:02:51,540 DEBUG [StoreOpener-fde83397e93ddec5368d04ff53b46f49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/cf 2023-10-02 13:02:51,540 DEBUG [StoreOpener-fde83397e93ddec5368d04ff53b46f49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/cf 2023-10-02 13:02:51,540 INFO [StoreOpener-fde83397e93ddec5368d04ff53b46f49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fde83397e93ddec5368d04ff53b46f49 columnFamilyName cf 2023-10-02 13:02:51,541 INFO [StoreOpener-0a2d45e25ad8772327d73e1a15c79273-1] regionserver.HStore(310): Store=0a2d45e25ad8772327d73e1a15c79273/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:51,543 INFO [StoreOpener-fde83397e93ddec5368d04ff53b46f49-1] regionserver.HStore(310): Store=fde83397e93ddec5368d04ff53b46f49/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:02:51,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:02:51,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:02:51,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:02:51,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:02:51,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:02:51,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:02:51,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:02:51,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:02:51,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a2d45e25ad8772327d73e1a15c79273; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68852995, jitterRate=0.025989577174186707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:02:51,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a2d45e25ad8772327d73e1a15c79273: 2023-10-02 13:02:51,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fde83397e93ddec5368d04ff53b46f49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69958818, jitterRate=0.0424676239490509}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:02:51,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fde83397e93ddec5368d04ff53b46f49: 2023-10-02 13:02:51,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273., pid=30, masterSystemTime=1696251771531 2023-10-02 13:02:51,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49., pid=31, masterSystemTime=1696251771532 2023-10-02 13:02:51,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:51,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:51,555 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0a2d45e25ad8772327d73e1a15c79273, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,555 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696251771555"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251771555"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251771555"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251771555"}]},"ts":"1696251771555"} 2023-10-02 13:02:51,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:51,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:51,556 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fde83397e93ddec5368d04ff53b46f49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,557 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696251771556"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251771556"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251771556"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251771556"}]},"ts":"1696251771556"} 2023-10-02 13:02:51,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-02 13:02:51,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 0a2d45e25ad8772327d73e1a15c79273, server=jenkins-hbase4.apache.org,46465,1696251745531 in 180 msec 2023-10-02 13:02:51,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-02 13:02:51,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure fde83397e93ddec5368d04ff53b46f49, server=jenkins-hbase4.apache.org,33895,1696251745577 in 180 msec 2023-10-02 13:02:51,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0a2d45e25ad8772327d73e1a15c79273, ASSIGN in 350 msec 2023-10-02 13:02:51,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-02 13:02:51,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fde83397e93ddec5368d04ff53b46f49, ASSIGN in 352 msec 2023-10-02 13:02:51,566 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 13:02:51,566 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251771566"}]},"ts":"1696251771566"} 2023-10-02 13:02:51,568 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-02 13:02:51,571 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 13:02:51,571 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-02 13:02:51,573 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 13:02:51,575 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:51,575 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:51,575 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:51,575 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:02:51,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 13:02:51,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 13:02:51,577 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 13:02:51,577 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 13:02:51,578 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 452 msec 2023-10-02 13:02:51,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 13:02:51,738 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-02 13:02:51,740 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-02 13:02:51,741 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:51,743 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:02:51,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:02:51,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251771757 (current time:1696251771757). 2023-10-02 13:02:51,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:02:51,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x4bf7214c to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:51,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47517221, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:51,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:51,766 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:51,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bf7214c to 127.0.0.1:55009 2023-10-02 13:02:51,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:02:51,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x3ea2f710 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:51,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cad4cc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:51,776 DEBUG [hconnection-0x21ef07-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:51,778 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:51,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:51,783 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:51,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ea2f710 to 127.0.0.1:55009 2023-10-02 13:02:51,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:02:51,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 13:02:51,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:02:51,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:02:51,789 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:02:51,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:02:51,793 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:02:51,794 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696252371794 2023-10-02 13:02:51,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-02 13:02:51,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:02:51,795 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:02:51,795 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:02:51,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 13:02:51,796 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:02:51,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-02 13:02:51,799 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 13:02:51,800 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696252371800 2023-10-02 13:02:51,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,813 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-02 13:02:51,813 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:51,814 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-02 13:02:51,815 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-02 13:02:51,815 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,815 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,816 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:51,816 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:51,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:51,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:51,816 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:51,816 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,817 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,817 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,818 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,818 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:02:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 13:02:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 13:02:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 13:02:51,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 13:02:51,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,818 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 13:02:51,819 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:51,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 13:02:51,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,819 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 13:02:51,823 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,825 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 13:02:51,824 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 13:02:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 13:02:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 13:02:51,826 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:51,826 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 13:02:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 13:02:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 13:02:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 13:02:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 13:02:51,828 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 13:02:51,828 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 13:02:51,830 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,836 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:51,836 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:51,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:51,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-02 13:02:51,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@250f91b5[Count = 1] remaining members to acquire global barrier 2023-10-02 13:02:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:51,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-02 13:02:51,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@250f91b5[Count = 0] remaining members to acquire global barrier 2023-10-02 13:02:51,843 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 13:02:51,843 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,844 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,844 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,844 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,845 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,845 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:02:51,845 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:02:51,845 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 13:02:51,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,845 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:02:51,845 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:02:51,845 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:02:51,845 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:02:51,845 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:51,845 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,845 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. started... 2023-10-02 13:02:51,845 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:02:51,846 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a2d45e25ad8772327d73e1a15c79273: 2023-10-02 13:02:51,846 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:02:51,846 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:02:51,846 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,846 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:51,846 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:02:51,846 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. started... 2023-10-02 13:02:51,846 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:02:51,848 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fde83397e93ddec5368d04ff53b46f49: 2023-10-02 13:02:51,848 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,848 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 13:02:51,848 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:02:51,848 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:51,848 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:02:51,849 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 13:02:51,870 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. completed. 2023-10-02 13:02:51,871 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:51,871 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:02:51,871 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:02:51,871 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,871 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 13:02:51,871 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:02:51,875 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,875 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. completed. 2023-10-02 13:02:51,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:51,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:51,876 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 13:02:51,876 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:51,876 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:51,876 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:02:51,876 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 13:02:51,877 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:02:51,877 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,877 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 13:02:51,877 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:02:51,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:51,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:51,879 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 13:02:51,880 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:51,880 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,880 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 13:02:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46465,1696251745531': 2023-10-02 13:02:51,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 13:02:51,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:51,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:51,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:51,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:51,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:51,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33895,1696251745577': 2023-10-02 13:02:51,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 13:02:51,887 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-02 13:02:51,887 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:02:51,887 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:02:51,887 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,887 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:02:51,889 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,889 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,889 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,889 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:51,889 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:51,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,889 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,889 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:51,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:51,890 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:51,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:51,891 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,891 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:51,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,893 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:51,894 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,894 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,895 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:02:51,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 13:02:51,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:02:51,897 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:02:51,897 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,897 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:51,897 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:51,898 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:51,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:51,901 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:51,901 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:51,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:51,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:51,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:51,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:51,898 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,898 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:51,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,898 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:51,905 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-02 13:02:51,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:51,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,905 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:51,905 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:02:51,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:51,907 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,907 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:51,907 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,908 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:51,908 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:51,908 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,908 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:51,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:51,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 13:02:51,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,942 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-02 13:02:51,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,943 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 13:02:51,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696251771794Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696251771920 (+126 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696251771920Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696251771920Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696251771925 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696251771934 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696251771942 (+8 ms) 2023-10-02 13:02:51,946 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 13:02:51,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 151 msec 2023-10-02 13:02:52,097 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:02:52,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 13:02:52,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:02:52,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46465] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:02:52,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33895] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:02:52,111 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-02 13:02:52,111 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:52,111 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:02:52,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:02:52,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251772125 (current time:1696251772125). 2023-10-02 13:02:52,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:02:52,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x60ede106 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:52,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a35448, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:52,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:52,139 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:52,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60ede106 to 127.0.0.1:55009 2023-10-02 13:02:52,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:02:52,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x50385042 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:02:52,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44487034, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:02:52,148 DEBUG [hconnection-0x6ba0d9dc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:52,150 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:52,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:02:52,156 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:02:52,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50385042 to 127.0.0.1:55009 2023-10-02 13:02:52,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:02:52,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 13:02:52,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:02:52,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:02:52,162 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:02:52,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:02:52,164 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:02:52,165 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696252372165 2023-10-02 13:02:52,165 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-02 13:02:52,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:02:52,167 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:02:52,167 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:02:52,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 13:02:52,168 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:02:52,170 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-02 13:02:52,171 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 13:02:52,171 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696252372171 2023-10-02 13:02:52,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-02 13:02:52,191 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-02 13:02:52,191 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:52,193 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-02 13:02:52,193 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-02 13:02:52,193 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,193 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,195 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:52,195 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:52,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:52,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:52,195 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:52,195 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:52,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:52,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:52,196 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,196 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,197 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,197 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:02:52,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 13:02:52,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 13:02:52,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 13:02:52,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 13:02:52,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 13:02:52,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 13:02:52,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 13:02:52,198 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 13:02:52,198 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:52,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 13:02:52,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 13:02:52,200 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 13:02:52,200 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 13:02:52,200 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 13:02:52,200 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:52,200 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:02:52,201 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 13:02:52,202 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 13:02:52,202 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 13:02:52,200 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 13:02:52,202 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 13:02:52,202 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 13:02:52,202 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 13:02:52,202 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 13:02:52,204 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,205 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,205 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,205 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:52,205 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,205 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:52,208 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:52,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:52,209 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,209 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:52,209 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,209 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:02:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 13:02:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:52,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-02 13:02:52,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d48389e[Count = 1] remaining members to acquire global barrier 2023-10-02 13:02:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:52,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 13:02:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:52,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-02 13:02:52,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d48389e[Count = 0] remaining members to acquire global barrier 2023-10-02 13:02:52,213 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 13:02:52,213 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,216 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,216 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,216 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,216 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:02:52,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,216 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 13:02:52,216 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:02:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,216 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,216 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:02:52,216 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:02:52,216 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:02:52,216 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:02:52,216 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:52,216 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:02:52,216 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. started... 2023-10-02 13:02:52,217 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,217 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:02:52,217 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:02:52,216 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:52,217 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. started... 2023-10-02 13:02:52,217 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fde83397e93ddec5368d04ff53b46f49 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-02 13:02:52,217 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a2d45e25ad8772327d73e1a15c79273 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-02 13:02:52,218 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 13:02:52,218 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:52,218 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 13:02:52,259 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310028c3ca762278d4e2a841feb9fc873bf78 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310028c3ca762278d4e2a841feb9fc873bf78 2023-10-02 13:02:52,267 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:02:52,268 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310029c550c26dc35437682519630d094efa6 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310029c550c26dc35437682519630d094efa6 2023-10-02 13:02:52,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 13:02:52,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:02:52,269 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:02:52,277 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/.tmp/cf/d724e0bfc2804d2a98d215323271ca49 2023-10-02 13:02:52,284 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/.tmp/cf/d724e0bfc2804d2a98d215323271ca49 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/cf/d724e0bfc2804d2a98d215323271ca49 2023-10-02 13:02:52,285 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/.tmp/cf/7233d75a1e0148719cdc49c599efacd3 2023-10-02 13:02:52,291 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/cf/d724e0bfc2804d2a98d215323271ca49, entries=4, sequenceid=6, filesize=5.6 K 2023-10-02 13:02:52,292 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/.tmp/cf/7233d75a1e0148719cdc49c599efacd3 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/cf/7233d75a1e0148719cdc49c599efacd3 2023-10-02 13:02:52,293 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 0a2d45e25ad8772327d73e1a15c79273 in 76ms, sequenceid=6, compaction requested=false 2023-10-02 13:02:52,293 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-02 13:02:52,294 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a2d45e25ad8772327d73e1a15c79273: 2023-10-02 13:02:52,294 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 13:02:52,294 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:02:52,294 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/cf/d724e0bfc2804d2a98d215323271ca49] hfiles 2023-10-02 13:02:52,294 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/cf/d724e0bfc2804d2a98d215323271ca49 for snapshot=snaptb0-testExportFileSystemState 2023-10-02 13:02:52,300 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/cf/7233d75a1e0148719cdc49c599efacd3, entries=46, sequenceid=6, filesize=12.7 K 2023-10-02 13:02:52,301 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for fde83397e93ddec5368d04ff53b46f49 in 84ms, sequenceid=6, compaction requested=false 2023-10-02 13:02:52,306 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fde83397e93ddec5368d04ff53b46f49: 2023-10-02 13:02:52,306 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 13:02:52,307 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:02:52,307 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/cf/7233d75a1e0148719cdc49c599efacd3] hfiles 2023-10-02 13:02:52,307 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/cf/7233d75a1e0148719cdc49c599efacd3 for snapshot=snaptb0-testExportFileSystemState 2023-10-02 13:02:52,327 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. completed. 2023-10-02 13:02:52,327 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:02:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:02:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:02:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 13:02:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:02:52,332 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 13:02:52,332 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,332 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:52,332 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 13:02:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 13:02:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:52,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 13:02:52,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46465,1696251745531': 2023-10-02 13:02:52,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 13:02:52,350 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. completed. 2023-10-02 13:02:52,350 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:02:52,350 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:02:52,351 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:02:52,351 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,351 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 13:02:52,351 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:02:52,353 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 13:02:52,353 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,353 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:52,353 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 13:02:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 13:02:52,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:52,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 13:02:52,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33895,1696251745577': 2023-10-02 13:02:52,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 13:02:52,359 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-02 13:02:52,359 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:02:52,359 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:02:52,359 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-02 13:02:52,359 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:02:52,361 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,362 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,362 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:52,362 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,361 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:02:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:02:52,362 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,362 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,362 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:02:52,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:52,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 13:02:52,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,363 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:02:52,364 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 13:02:52,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:02:52,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 13:02:52,366 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,366 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,366 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:52,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:52,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:52,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:52,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:52,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:52,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:52,370 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:02:52,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:52,370 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:02:52,372 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:02:52,372 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:02:52,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:52,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-02 13:02:52,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:52,372 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-02 13:02:52,372 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 13:02:52,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:02:52,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:52,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:52,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:02:52,373 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:02:52,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:02:52,373 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:02:52,373 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,373 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:02:52,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:02:52,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310029c550c26dc35437682519630d094efa6, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310028c3ca762278d4e2a841feb9fc873bf78] mob files 2023-10-02 13:02:52,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310029c550c26dc35437682519630d094efa6 2023-10-02 13:02:52,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310028c3ca762278d4e2a841feb9fc873bf78 2023-10-02 13:02:52,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-02 13:02:52,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,411 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-02 13:02:52,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,412 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696251772165Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696251772383 (+218 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696251772383Loading Region manifests for snaptb0-testExportFileSystemState at 1696251772383Writing data manifest for snaptb0-testExportFileSystemState at 1696251772389 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696251772402 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696251772411 (+9 ms) 2023-10-02 13:02:52,415 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 13:02:52,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 249 msec 2023-10-02 13:02:52,469 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:02:52,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 13:02:52,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:02:52,471 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251772471 2023-10-02 13:02:52,471 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35861, tgtDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251772471, rawTgtDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251772471, srcFsUri=hdfs://localhost:35861, srcDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:02:52,505 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:02:52,506 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2141463769_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251772471, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251772471/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,506 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c, snapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-02 13:02:52,523 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251772471/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 13:02:52,571 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:52,571 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:52,572 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:52,572 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:53,493 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-8774752925582275872.jar 2023-10-02 13:02:53,494 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:53,494 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:53,563 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-2701288557278264990.jar 2023-10-02 13:02:53,563 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:53,564 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:53,564 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:53,564 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:53,565 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:53,565 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 13:02:53,566 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 13:02:53,566 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 13:02:53,566 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 13:02:53,567 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 13:02:53,567 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 13:02:53,568 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 13:02:53,568 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 13:02:53,568 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 13:02:53,569 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 13:02:53,569 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 13:02:53,570 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:02:53,570 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:02:53,571 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:02:53,571 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:02:53,571 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:02:53,572 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:02:53,573 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:02:54,040 WARN [Listener at jenkins-hbase4.apache.org/39417] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 13:02:54,043 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-02 13:02:54,045 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-02 13:02:54,794 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:02:54,794 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:02:54,800 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0001_000001 (auth:SIMPLE) 2023-10-02 13:02:55,562 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0002_000001 (auth:SIMPLE) 2023-10-02 13:02:56,386 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 13:02:59,671 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0002_000001 (auth:SIMPLE) 2023-10-02 13:03:01,908 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0002_000001 (auth:SIMPLE) 2023-10-02 13:03:05,042 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0002_000001 (auth:SIMPLE) 2023-10-02 13:03:06,268 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 13:03:06,269 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 13:03:06,276 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-02 13:03:06,277 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 13:03:06,277 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 13:03:06,277 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 13:03:06,278 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-02 13:03:06,278 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-02 13:03:06,278 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251772471/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251772471/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 13:03:06,278 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251772471/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-02 13:03:06,278 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251772471/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-02 13:03:06,285 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-02 13:03:06,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-02 13:03:06,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-02 13:03:06,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 13:03:06,291 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251786291"}]},"ts":"1696251786291"} 2023-10-02 13:03:06,293 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-02 13:03:06,295 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-02 13:03:06,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0a2d45e25ad8772327d73e1a15c79273, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fde83397e93ddec5368d04ff53b46f49, UNASSIGN}] 2023-10-02 13:03:06,298 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0a2d45e25ad8772327d73e1a15c79273, UNASSIGN 2023-10-02 13:03:06,298 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fde83397e93ddec5368d04ff53b46f49, UNASSIGN 2023-10-02 13:03:06,299 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0a2d45e25ad8772327d73e1a15c79273, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:06,299 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=fde83397e93ddec5368d04ff53b46f49, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:06,299 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696251786299"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251786299"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251786299"}]},"ts":"1696251786299"} 2023-10-02 13:03:06,299 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696251786299"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251786299"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251786299"}]},"ts":"1696251786299"} 2023-10-02 13:03:06,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 0a2d45e25ad8772327d73e1a15c79273, server=jenkins-hbase4.apache.org,46465,1696251745531}] 2023-10-02 13:03:06,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure fde83397e93ddec5368d04ff53b46f49, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:03:06,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 13:03:06,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:03:06,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a2d45e25ad8772327d73e1a15c79273, disabling compactions & flushes 2023-10-02 13:03:06,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:03:06,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:03:06,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. after waiting 0 ms 2023-10-02 13:03:06,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:03:06,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:03:06,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fde83397e93ddec5368d04ff53b46f49, disabling compactions & flushes 2023-10-02 13:03:06,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:03:06,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:03:06,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. after waiting 0 ms 2023-10-02 13:03:06,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:03:06,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:03:06,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:03:06,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:03:06,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:03:06,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273. 2023-10-02 13:03:06,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a2d45e25ad8772327d73e1a15c79273: 2023-10-02 13:03:06,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49. 2023-10-02 13:03:06,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fde83397e93ddec5368d04ff53b46f49: 2023-10-02 13:03:06,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:03:06,470 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=fde83397e93ddec5368d04ff53b46f49, regionState=CLOSED 2023-10-02 13:03:06,470 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696251786470"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251786470"}]},"ts":"1696251786470"} 2023-10-02 13:03:06,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:03:06,471 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0a2d45e25ad8772327d73e1a15c79273, regionState=CLOSED 2023-10-02 13:03:06,471 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696251786471"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251786471"}]},"ts":"1696251786471"} 2023-10-02 13:03:06,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-02 13:03:06,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-02 13:03:06,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure fde83397e93ddec5368d04ff53b46f49, server=jenkins-hbase4.apache.org,33895,1696251745577 in 169 msec 2023-10-02 13:03:06,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 0a2d45e25ad8772327d73e1a15c79273, server=jenkins-hbase4.apache.org,46465,1696251745531 in 171 msec 2023-10-02 13:03:06,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fde83397e93ddec5368d04ff53b46f49, UNASSIGN in 179 msec 2023-10-02 13:03:06,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-02 13:03:06,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0a2d45e25ad8772327d73e1a15c79273, UNASSIGN in 179 msec 2023-10-02 13:03:06,478 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251786478"}]},"ts":"1696251786478"} 2023-10-02 13:03:06,479 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-02 13:03:06,480 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-02 13:03:06,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-10-02 13:03:06,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 13:03:06,594 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-02 13:03:06,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-02 13:03:06,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 13:03:06,598 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 13:03:06,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-02 13:03:06,599 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 13:03:06,601 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-02 13:03:06,604 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 13:03:06,604 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 13:03:06,604 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 13:03:06,605 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 13:03:06,605 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:03:06,605 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:03:06,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 13:03:06,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 13:03:06,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 13:03:06,606 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 13:03:06,607 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 13:03:06,607 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 13:03:06,607 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:06,607 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 13:03:06,607 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 13:03:06,607 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:06,607 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:06,607 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:06,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-02 13:03:06,608 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/recovered.edits] 2023-10-02 13:03:06,609 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/recovered.edits] 2023-10-02 13:03:06,613 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/cf/7233d75a1e0148719cdc49c599efacd3 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/cf/7233d75a1e0148719cdc49c599efacd3 2023-10-02 13:03:06,614 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/cf/d724e0bfc2804d2a98d215323271ca49 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/cf/d724e0bfc2804d2a98d215323271ca49 2023-10-02 13:03:06,617 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49/recovered.edits/9.seqid 2023-10-02 13:03:06,617 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273/recovered.edits/9.seqid 2023-10-02 13:03:06,618 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/fde83397e93ddec5368d04ff53b46f49 2023-10-02 13:03:06,618 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemState/0a2d45e25ad8772327d73e1a15c79273 2023-10-02 13:03:06,618 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-02 13:03:06,619 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-02 13:03:06,619 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-02 13:03:06,623 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310029c550c26dc35437682519630d094efa6 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310029c550c26dc35437682519630d094efa6 2023-10-02 13:03:06,625 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310028c3ca762278d4e2a841feb9fc873bf78 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310028c3ca762278d4e2a841feb9fc873bf78 2023-10-02 13:03:06,625 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-02 13:03:06,628 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 13:03:06,630 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-02 13:03:06,633 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-02 13:03:06,634 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 13:03:06,634 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-02 13:03:06,635 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251786634"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:06,635 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251786634"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:06,637 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 13:03:06,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a2d45e25ad8772327d73e1a15c79273, NAME => 'testtb-testExportFileSystemState,,1696251771122.0a2d45e25ad8772327d73e1a15c79273.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fde83397e93ddec5368d04ff53b46f49, NAME => 'testtb-testExportFileSystemState,1,1696251771122.fde83397e93ddec5368d04ff53b46f49.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 13:03:06,637 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-02 13:03:06,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696251786637"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:06,639 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-02 13:03:06,641 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 13:03:06,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 46 msec 2023-10-02 13:03:06,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-02 13:03:06,709 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-02 13:03:06,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-02 13:03:06,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-02 13:03:06,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-02 13:03:06,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-02 13:03:06,747 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 756) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1910452160_1 at /127.0.0.1:40438 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:45448 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:39096 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2078 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1910452160_1 at /127.0.0.1:47190 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase4.apache.org/172.31.14.131:39417 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase4.apache.org/172.31.14.131:46809 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:52554 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=938 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 225) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1467 (was 1616) 2023-10-02 13:03:06,747 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-02 13:03:06,766 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=235, ProcessCount=168, AvailableMemoryMB=1466 2023-10-02 13:03:06,766 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-02 13:03:06,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 13:03:06,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-02 13:03:06,772 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 13:03:06,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-02 13:03:06,773 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 13:03:06,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 13:03:06,776 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:06,776 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:06,776 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594 empty. 2023-10-02 13:03:06,776 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a empty. 2023-10-02 13:03:06,777 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:06,777 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:06,777 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-02 13:03:06,789 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-02 13:03:06,791 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => eebc7a8f89251dd4b865e6b46a5a4594, NAME => 'testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:03:06,791 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 92fbd32fffe039b78f481bb3a670c29a, NAME => 'testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:03:06,801 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:06,801 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing eebc7a8f89251dd4b865e6b46a5a4594, disabling compactions & flushes 2023-10-02 13:03:06,801 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:06,801 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:06,801 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. after waiting 0 ms 2023-10-02 13:03:06,802 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:06,802 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:06,802 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for eebc7a8f89251dd4b865e6b46a5a4594: 2023-10-02 13:03:06,804 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:06,804 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 92fbd32fffe039b78f481bb3a670c29a, disabling compactions & flushes 2023-10-02 13:03:06,804 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:06,804 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:06,804 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. after waiting 0 ms 2023-10-02 13:03:06,804 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:06,804 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:06,804 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 92fbd32fffe039b78f481bb3a670c29a: 2023-10-02 13:03:06,807 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 13:03:06,808 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696251786807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251786807"}]},"ts":"1696251786807"} 2023-10-02 13:03:06,808 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696251786807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251786807"}]},"ts":"1696251786807"} 2023-10-02 13:03:06,810 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 13:03:06,811 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 13:03:06,812 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251786811"}]},"ts":"1696251786811"} 2023-10-02 13:03:06,813 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-02 13:03:06,817 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 13:03:06,818 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 13:03:06,818 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 13:03:06,818 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 13:03:06,818 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 13:03:06,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eebc7a8f89251dd4b865e6b46a5a4594, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92fbd32fffe039b78f481bb3a670c29a, ASSIGN}] 2023-10-02 13:03:06,822 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92fbd32fffe039b78f481bb3a670c29a, ASSIGN 2023-10-02 13:03:06,822 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eebc7a8f89251dd4b865e6b46a5a4594, ASSIGN 2023-10-02 13:03:06,823 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eebc7a8f89251dd4b865e6b46a5a4594, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46551,1696251745482; forceNewPlan=false, retain=false 2023-10-02 13:03:06,823 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92fbd32fffe039b78f481bb3a670c29a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33895,1696251745577; forceNewPlan=false, retain=false 2023-10-02 13:03:06,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 13:03:06,973 INFO [jenkins-hbase4:34719] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 13:03:06,976 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=eebc7a8f89251dd4b865e6b46a5a4594, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:06,976 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=92fbd32fffe039b78f481bb3a670c29a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:06,976 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696251786976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251786976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251786976"}]},"ts":"1696251786976"} 2023-10-02 13:03:06,976 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696251786976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251786976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251786976"}]},"ts":"1696251786976"} 2023-10-02 13:03:06,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure eebc7a8f89251dd4b865e6b46a5a4594, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:03:06,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 92fbd32fffe039b78f481bb3a670c29a, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:03:07,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 13:03:07,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:07,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:07,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92fbd32fffe039b78f481bb3a670c29a, NAME => 'testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 13:03:07,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eebc7a8f89251dd4b865e6b46a5a4594, NAME => 'testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 13:03:07,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. service=AccessControlService 2023-10-02 13:03:07,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. service=AccessControlService 2023-10-02 13:03:07,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:03:07,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:03:07,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:07,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:07,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:07,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:07,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:07,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:07,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:07,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:07,138 INFO [StoreOpener-92fbd32fffe039b78f481bb3a670c29a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:07,138 INFO [StoreOpener-eebc7a8f89251dd4b865e6b46a5a4594-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:07,139 DEBUG [StoreOpener-92fbd32fffe039b78f481bb3a670c29a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/cf 2023-10-02 13:03:07,139 DEBUG [StoreOpener-92fbd32fffe039b78f481bb3a670c29a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/cf 2023-10-02 13:03:07,140 DEBUG [StoreOpener-eebc7a8f89251dd4b865e6b46a5a4594-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/cf 2023-10-02 13:03:07,140 DEBUG [StoreOpener-eebc7a8f89251dd4b865e6b46a5a4594-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/cf 2023-10-02 13:03:07,140 INFO [StoreOpener-92fbd32fffe039b78f481bb3a670c29a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92fbd32fffe039b78f481bb3a670c29a columnFamilyName cf 2023-10-02 13:03:07,140 INFO [StoreOpener-eebc7a8f89251dd4b865e6b46a5a4594-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eebc7a8f89251dd4b865e6b46a5a4594 columnFamilyName cf 2023-10-02 13:03:07,141 INFO [StoreOpener-eebc7a8f89251dd4b865e6b46a5a4594-1] regionserver.HStore(310): Store=eebc7a8f89251dd4b865e6b46a5a4594/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:03:07,141 INFO [StoreOpener-92fbd32fffe039b78f481bb3a670c29a-1] regionserver.HStore(310): Store=92fbd32fffe039b78f481bb3a670c29a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:03:07,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:07,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:07,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:07,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:07,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:07,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:07,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:03:07,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:03:07,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 92fbd32fffe039b78f481bb3a670c29a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73157687, jitterRate=0.09013448655605316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:03:07,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eebc7a8f89251dd4b865e6b46a5a4594; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69007802, jitterRate=0.02829638123512268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:03:07,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 92fbd32fffe039b78f481bb3a670c29a: 2023-10-02 13:03:07,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eebc7a8f89251dd4b865e6b46a5a4594: 2023-10-02 13:03:07,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a., pid=46, masterSystemTime=1696251787131 2023-10-02 13:03:07,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594., pid=45, masterSystemTime=1696251787130 2023-10-02 13:03:07,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:07,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:07,152 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=92fbd32fffe039b78f481bb3a670c29a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:07,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:07,152 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696251787151"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251787151"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251787151"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251787151"}]},"ts":"1696251787151"} 2023-10-02 13:03:07,152 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=eebc7a8f89251dd4b865e6b46a5a4594, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,152 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696251787152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251787152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251787152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251787152"}]},"ts":"1696251787152"} 2023-10-02 13:03:07,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-02 13:03:07,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 92fbd32fffe039b78f481bb3a670c29a, server=jenkins-hbase4.apache.org,33895,1696251745577 in 174 msec 2023-10-02 13:03:07,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92fbd32fffe039b78f481bb3a670c29a, ASSIGN in 338 msec 2023-10-02 13:03:07,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-02 13:03:07,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure eebc7a8f89251dd4b865e6b46a5a4594, server=jenkins-hbase4.apache.org,46551,1696251745482 in 178 msec 2023-10-02 13:03:07,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-02 13:03:07,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eebc7a8f89251dd4b865e6b46a5a4594, ASSIGN in 340 msec 2023-10-02 13:03:07,161 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 13:03:07,161 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251787161"}]},"ts":"1696251787161"} 2023-10-02 13:03:07,162 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-02 13:03:07,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 13:03:07,165 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-02 13:03:07,166 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 13:03:07,168 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:07,168 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:07,168 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:07,168 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:07,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:07,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:07,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:07,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:07,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 401 msec 2023-10-02 13:03:07,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 13:03:07,378 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-02 13:03:07,380 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-02 13:03:07,380 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:07,383 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:03:07,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 13:03:07,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251787395 (current time:1696251787395). 2023-10-02 13:03:07,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:03:07,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x2dc05bf0 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:07,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cf77ff5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:07,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:07,410 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:07,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2dc05bf0 to 127.0.0.1:55009 2023-10-02 13:03:07,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:07,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x1e16a924 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:07,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31a67ecd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:07,420 DEBUG [hconnection-0x76e9a7db-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:07,423 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:07,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:07,429 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e16a924 to 127.0.0.1:55009 2023-10-02 13:03:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 13:03:07,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:03:07,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 13:03:07,435 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:03:07,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 13:03:07,437 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 13:03:07,438 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696252387438 2023-10-02 13:03:07,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 13:03:07,438 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-02 13:03:07,439 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:03:07,439 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:03:07,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 13:03:07,442 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 13:03:07,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-10-02 13:03:07,444 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 13:03:07,445 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696252387445 2023-10-02 13:03:07,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,458 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-02 13:03:07,458 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:07,459 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-02 13:03:07,459 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-02 13:03:07,460 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,460 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,462 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,462 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,462 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,462 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,462 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,462 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,463 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,463 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,463 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 13:03:07,464 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 13:03:07,464 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:07,464 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 13:03:07,465 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 13:03:07,465 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 13:03:07,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,465 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 13:03:07,465 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 13:03:07,465 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:07,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,466 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 13:03:07,467 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 13:03:07,467 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:07,467 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 13:03:07,470 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 13:03:07,470 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 13:03:07,470 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 13:03:07,470 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 13:03:07,471 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,472 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:07,473 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,473 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,473 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:07,473 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,473 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:07,473 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,473 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:07,473 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,473 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:07,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-02 13:03:07,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3de6d5c4[Count = 1] remaining members to acquire global barrier 2023-10-02 13:03:07,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:07,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:07,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:07,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:07,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:07,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-02 13:03:07,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3de6d5c4[Count = 0] remaining members to acquire global barrier 2023-10-02 13:03:07,477 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-02 13:03:07,477 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,479 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,479 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,479 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 13:03:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 13:03:07,479 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:07,479 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:07,479 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 13:03:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 13:03:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:07,480 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:03:07,479 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. started... 2023-10-02 13:03:07,479 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,480 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:03:07,479 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. started... 2023-10-02 13:03:07,481 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eebc7a8f89251dd4b865e6b46a5a4594: 2023-10-02 13:03:07,481 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92fbd32fffe039b78f481bb3a670c29a: 2023-10-02 13:03:07,481 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,481 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,482 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:07,482 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:03:07,481 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:07,482 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:03:07,489 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 13:03:07,489 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:07,489 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 13:03:07,494 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. completed. 2023-10-02 13:03:07,494 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:07,494 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. completed. 2023-10-02 13:03:07,494 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:07,494 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:07,494 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:07,495 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:07,495 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:07,495 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,495 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,495 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 13:03:07,495 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 13:03:07,495 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:03:07,495 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:03:07,496 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,496 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 13:03:07,496 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,496 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:07,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:07,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:07,496 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 13:03:07,496 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 13:03:07,498 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:07,498 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 13:03:07,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:07,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:07,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:07,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46551,1696251745482': 2023-10-02 13:03:07,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-02 13:03:07,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:07,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:07,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:07,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:07,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:07,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33895,1696251745577': 2023-10-02 13:03:07,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-02 13:03:07,506 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-02 13:03:07,506 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:03:07,506 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:03:07,506 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,506 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:03:07,507 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,507 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,508 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,508 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,508 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,507 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,508 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,508 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,508 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:07,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,509 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:07,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,511 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,511 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:07,512 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,516 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,516 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,516 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,516 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,516 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,516 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,517 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,516 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,516 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,517 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-02 13:03:07,516 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:07,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,516 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,516 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,518 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,518 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:03:07,519 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,519 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,519 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,519 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,519 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 13:03:07,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,539 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:07,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 13:03:07,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:03:07,541 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:03:07,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,546 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-02 13:03:07,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,546 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:07,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696251787438Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696251787527 (+89 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696251787527Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696251787527Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696251787531 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696251787539 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696251787546 (+7 ms) 2023-10-02 13:03:07,549 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 13:03:07,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 110 msec 2023-10-02 13:03:07,741 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:07,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 13:03:07,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:03:07,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46551] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:03:07,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33895] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:03:07,750 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-02 13:03:07,750 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:07,750 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:03:07,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 13:03:07,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251787760 (current time:1696251787760). 2023-10-02 13:03:07,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:03:07,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x0d5d7d5d to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:07,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14c98b58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:07,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:07,781 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:07,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d5d7d5d to 127.0.0.1:55009 2023-10-02 13:03:07,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:07,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x684ba4c8 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:07,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e1a8b09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:07,792 DEBUG [hconnection-0x56d142d9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:07,794 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:07,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:07,799 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:07,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x684ba4c8 to 127.0.0.1:55009 2023-10-02 13:03:07,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:07,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 13:03:07,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:03:07,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 13:03:07,804 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:03:07,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 13:03:07,807 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 13:03:07,808 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696252387808 2023-10-02 13:03:07,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 13:03:07,808 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-02 13:03:07,810 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:03:07,810 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:03:07,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 13:03:07,811 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 13:03:07,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-10-02 13:03:07,814 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 13:03:07,814 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696252387814 2023-10-02 13:03:07,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-02 13:03:07,829 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-02 13:03:07,829 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:07,831 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-02 13:03:07,831 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-02 13:03:07,831 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,831 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,833 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,833 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,833 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,833 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,834 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,834 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,834 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,834 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:03:07,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 13:03:07,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,835 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 13:03:07,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 13:03:07,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,835 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 13:03:07,835 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 13:03:07,835 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 13:03:07,835 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:07,835 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 13:03:07,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 13:03:07,837 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 13:03:07,837 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:07,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,837 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 13:03:07,838 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 13:03:07,838 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 13:03:07,838 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 13:03:07,838 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 13:03:07,838 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 13:03:07,838 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 13:03:07,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 13:03:07,838 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 13:03:07,839 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:07,839 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 13:03:07,839 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 13:03:07,839 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 13:03:07,840 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,841 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,841 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,841 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:07,841 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:07,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:07,842 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,842 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,842 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:07,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:07,842 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:07,842 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,843 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:07,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 13:03:07,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:07,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-02 13:03:07,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@512d8181[Count = 1] remaining members to acquire global barrier 2023-10-02 13:03:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:07,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:07,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 13:03:07,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:07,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-02 13:03:07,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@512d8181[Count = 0] remaining members to acquire global barrier 2023-10-02 13:03:07,849 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-02 13:03:07,849 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,852 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,852 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,852 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,852 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 13:03:07,852 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,852 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 13:03:07,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 13:03:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 13:03:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:03:07,853 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:07,853 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. started... 2023-10-02 13:03:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:07,853 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:07,853 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,853 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:03:07,853 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 92fbd32fffe039b78f481bb3a670c29a 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-02 13:03:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:07,853 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. started... 2023-10-02 13:03:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:07,853 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2745): Flushing eebc7a8f89251dd4b865e6b46a5a4594 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-02 13:03:07,855 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 13:03:07,855 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:07,855 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 13:03:07,873 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100273839ec0b38842c2bbab98685d6a720b to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100273839ec0b38842c2bbab98685d6a720b 2023-10-02 13:03:07,873 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231002e3ec0b1d62864e999681ad88321d0eee to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002e3ec0b1d62864e999681ad88321d0eee 2023-10-02 13:03:07,881 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/.tmp/cf/8b5ca2e6eaae46c2b728eb51aca23dd5 2023-10-02 13:03:07,882 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/.tmp/cf/bbcf6cfa8bdc4816b605631770422627 2023-10-02 13:03:07,891 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/.tmp/cf/bbcf6cfa8bdc4816b605631770422627 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/cf/bbcf6cfa8bdc4816b605631770422627 2023-10-02 13:03:07,891 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/.tmp/cf/8b5ca2e6eaae46c2b728eb51aca23dd5 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/cf/8b5ca2e6eaae46c2b728eb51aca23dd5 2023-10-02 13:03:07,896 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/cf/bbcf6cfa8bdc4816b605631770422627, entries=46, sequenceid=6, filesize=12.5 K 2023-10-02 13:03:07,896 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/cf/8b5ca2e6eaae46c2b728eb51aca23dd5, entries=4, sequenceid=6, filesize=5.6 K 2023-10-02 13:03:07,897 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for eebc7a8f89251dd4b865e6b46a5a4594 in 44ms, sequenceid=6, compaction requested=false 2023-10-02 13:03:07,897 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 92fbd32fffe039b78f481bb3a670c29a in 44ms, sequenceid=6, compaction requested=false 2023-10-02 13:03:07,897 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-02 13:03:07,897 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-02 13:03:07,899 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eebc7a8f89251dd4b865e6b46a5a4594: 2023-10-02 13:03:07,899 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92fbd32fffe039b78f481bb3a670c29a: 2023-10-02 13:03:07,899 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 13:03:07,899 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 13:03:07,899 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:07,899 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:07,899 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/cf/8b5ca2e6eaae46c2b728eb51aca23dd5] hfiles 2023-10-02 13:03:07,899 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/cf/bbcf6cfa8bdc4816b605631770422627] hfiles 2023-10-02 13:03:07,899 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/cf/bbcf6cfa8bdc4816b605631770422627 for snapshot=snaptb0-testConsecutiveExports 2023-10-02 13:03:07,899 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/cf/8b5ca2e6eaae46c2b728eb51aca23dd5 for snapshot=snaptb0-testConsecutiveExports 2023-10-02 13:03:07,907 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. completed. 2023-10-02 13:03:07,907 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 13:03:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:03:07,908 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. completed. 2023-10-02 13:03:07,908 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 13:03:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:03:07,909 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 13:03:07,909 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,909 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:07,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,910 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:07,909 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 13:03:07,911 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 13:03:07,911 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,911 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:07,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 13:03:07,911 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 13:03:07,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:03:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:07,913 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:03:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 13:03:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:07,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 13:03:07,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46551,1696251745482': 2023-10-02 13:03:07,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-02 13:03:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:07,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:07,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:07,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:07,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 13:03:07,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:07,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 13:03:07,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33895,1696251745577': 2023-10-02 13:03:07,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-02 13:03:07,918 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-02 13:03:07,918 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:03:07,918 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:03:07,918 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-02 13:03:07,918 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:03:07,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:07,921 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,922 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:07,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,922 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:07,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 13:03:07,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:07,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 13:03:07,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,924 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,924 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:07,925 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 13:03:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,931 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,931 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,931 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,931 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:07,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,931 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,931 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:07,931 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,931 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-02 13:03:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,931 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:07,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,931 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:07,933 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-02 13:03:07,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:07,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 13:03:07,933 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:03:07,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,934 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:07,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:07,934 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,934 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:07,934 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,935 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:07,935 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:07,935 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,935 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100273839ec0b38842c2bbab98685d6a720b, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002e3ec0b1d62864e999681ad88321d0eee] mob files 2023-10-02 13:03:07,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100273839ec0b38842c2bbab98685d6a720b 2023-10-02 13:03:07,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002e3ec0b1d62864e999681ad88321d0eee 2023-10-02 13:03:07,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-02 13:03:07,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-02 13:03:07,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,970 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 13:03:07,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696251787809Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696251787943 (+134 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696251787943Loading Region manifests for snaptb0-testConsecutiveExports at 1696251787943Writing data manifest for snaptb0-testConsecutiveExports at 1696251787947 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696251787962 (+15 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696251787970 (+8 ms) 2023-10-02 13:03:07,973 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 13:03:07,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 163 msec 2023-10-02 13:03:08,113 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:08,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 13:03:08,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:03:08,115 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114 2023-10-02 13:03:08,115 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114, srcFsUri=hdfs://localhost:35861, srcDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:03:08,145 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:03:08,145 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@47e46d57, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 13:03:08,146 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c, snapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-02 13:03:08,154 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 13:03:08,168 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:08,168 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:08,168 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:08,169 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:09,063 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-4806476602323390670.jar 2023-10-02 13:03:09,064 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:09,064 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:09,132 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-2990067198691506677.jar 2023-10-02 13:03:09,133 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:09,133 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:09,134 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:09,134 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:09,134 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:09,135 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:09,135 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 13:03:09,135 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 13:03:09,136 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 13:03:09,136 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 13:03:09,137 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 13:03:09,137 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 13:03:09,138 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 13:03:09,138 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 13:03:09,138 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 13:03:09,139 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 13:03:09,140 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:09,140 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:09,141 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:09,141 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:09,141 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:09,142 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:09,142 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:09,515 WARN [Listener at jenkins-hbase4.apache.org/39417] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 13:03:09,518 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-02 13:03:09,520 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-02 13:03:11,213 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:03:11,213 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:03:11,216 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0002_000001 (auth:SIMPLE) 2023-10-02 13:03:12,009 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0003_000001 (auth:SIMPLE) 2023-10-02 13:03:12,044 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 13:03:15,866 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0003_000001 (auth:SIMPLE) 2023-10-02 13:03:18,087 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0003_000001 (auth:SIMPLE) 2023-10-02 13:03:20,480 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0003_000001 (auth:SIMPLE) 2023-10-02 13:03:21,684 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 13:03:21,684 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 13:03:21,688 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-02 13:03:21,688 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 13:03:21,689 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 13:03:21,689 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 13:03:21,692 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 13:03:21,692 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 13:03:21,692 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6eb7a202 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 13:03:21,692 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 13:03:21,692 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 13:03:21,693 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114, srcFsUri=hdfs://localhost:35861, srcDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:03:21,715 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:03:21,715 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@74d721c5, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 13:03:21,715 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c, snapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-02 13:03:21,727 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 13:03:21,740 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:21,740 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:21,741 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:21,741 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:22,654 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-2399999558772917064.jar 2023-10-02 13:03:22,654 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:22,655 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:22,722 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-6667966428150980859.jar 2023-10-02 13:03:22,723 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:22,723 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:22,724 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:22,724 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:22,725 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:22,725 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:22,725 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 13:03:22,726 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 13:03:22,726 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 13:03:22,727 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 13:03:22,727 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 13:03:22,727 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 13:03:22,728 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 13:03:22,728 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 13:03:22,728 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 13:03:22,729 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 13:03:22,730 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:22,730 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:22,730 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:22,731 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:22,731 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:22,731 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:22,732 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:23,101 WARN [Listener at jenkins-hbase4.apache.org/39417] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 13:03:23,104 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-02 13:03:23,107 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-02 13:03:26,651 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:03:26,651 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:03:26,654 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0003_000001 (auth:SIMPLE) 2023-10-02 13:03:27,226 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0004_000001 (auth:SIMPLE) 2023-10-02 13:03:30,981 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0004_000001 (auth:SIMPLE) 2023-10-02 13:03:33,206 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0004_000001 (auth:SIMPLE) 2023-10-02 13:03:35,442 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0004_000001 (auth:SIMPLE) 2023-10-02 13:03:37,287 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 13:03:37,287 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 13:03:37,290 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-02 13:03:37,290 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 13:03:37,290 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 13:03:37,291 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 13:03:37,295 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 13:03:37,295 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 13:03:37,295 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6eb7a202 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 13:03:37,295 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 13:03:37,295 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/local-export-1696251788114/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 13:03:37,308 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-02 13:03:37,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-02 13:03:37,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-02 13:03:37,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 13:03:37,313 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251817313"}]},"ts":"1696251817313"} 2023-10-02 13:03:37,315 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-02 13:03:37,316 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-02 13:03:37,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eebc7a8f89251dd4b865e6b46a5a4594, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92fbd32fffe039b78f481bb3a670c29a, UNASSIGN}] 2023-10-02 13:03:37,319 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eebc7a8f89251dd4b865e6b46a5a4594, UNASSIGN 2023-10-02 13:03:37,319 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92fbd32fffe039b78f481bb3a670c29a, UNASSIGN 2023-10-02 13:03:37,320 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=eebc7a8f89251dd4b865e6b46a5a4594, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:37,320 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=92fbd32fffe039b78f481bb3a670c29a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:37,320 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696251817320"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251817320"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251817320"}]},"ts":"1696251817320"} 2023-10-02 13:03:37,320 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696251817320"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251817320"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251817320"}]},"ts":"1696251817320"} 2023-10-02 13:03:37,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure eebc7a8f89251dd4b865e6b46a5a4594, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:03:37,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 92fbd32fffe039b78f481bb3a670c29a, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:03:37,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 13:03:37,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:37,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eebc7a8f89251dd4b865e6b46a5a4594, disabling compactions & flushes 2023-10-02 13:03:37,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:37,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:37,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. after waiting 0 ms 2023-10-02 13:03:37,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:37,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:37,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 92fbd32fffe039b78f481bb3a670c29a, disabling compactions & flushes 2023-10-02 13:03:37,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:37,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:37,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. after waiting 0 ms 2023-10-02 13:03:37,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:37,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:03:37,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:03:37,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:03:37,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:03:37,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594. 2023-10-02 13:03:37,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a. 2023-10-02 13:03:37,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eebc7a8f89251dd4b865e6b46a5a4594: 2023-10-02 13:03:37,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 92fbd32fffe039b78f481bb3a670c29a: 2023-10-02 13:03:37,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:37,492 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=92fbd32fffe039b78f481bb3a670c29a, regionState=CLOSED 2023-10-02 13:03:37,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:37,492 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696251817492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251817492"}]},"ts":"1696251817492"} 2023-10-02 13:03:37,493 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=eebc7a8f89251dd4b865e6b46a5a4594, regionState=CLOSED 2023-10-02 13:03:37,493 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696251817493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251817493"}]},"ts":"1696251817493"} 2023-10-02 13:03:37,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-02 13:03:37,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 92fbd32fffe039b78f481bb3a670c29a, server=jenkins-hbase4.apache.org,33895,1696251745577 in 172 msec 2023-10-02 13:03:37,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-02 13:03:37,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure eebc7a8f89251dd4b865e6b46a5a4594, server=jenkins-hbase4.apache.org,46551,1696251745482 in 174 msec 2023-10-02 13:03:37,497 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=92fbd32fffe039b78f481bb3a670c29a, UNASSIGN in 179 msec 2023-10-02 13:03:37,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-02 13:03:37,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eebc7a8f89251dd4b865e6b46a5a4594, UNASSIGN in 179 msec 2023-10-02 13:03:37,499 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251817499"}]},"ts":"1696251817499"} 2023-10-02 13:03:37,500 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-02 13:03:37,501 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-02 13:03:37,503 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 193 msec 2023-10-02 13:03:37,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 13:03:37,616 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-02 13:03:37,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-02 13:03:37,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 13:03:37,620 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 13:03:37,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-02 13:03:37,621 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 13:03:37,624 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-02 13:03:37,627 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:37,627 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:37,627 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 13:03:37,627 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 13:03:37,627 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 13:03:37,627 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 13:03:37,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 13:03:37,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 13:03:37,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 13:03:37,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 13:03:37,629 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 13:03:37,629 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 13:03:37,629 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 13:03:37,629 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 13:03:37,629 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:37,629 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:37,629 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:37,629 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:37,629 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/recovered.edits] 2023-10-02 13:03:37,630 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/recovered.edits] 2023-10-02 13:03:37,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-02 13:03:37,635 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/cf/8b5ca2e6eaae46c2b728eb51aca23dd5 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/cf/8b5ca2e6eaae46c2b728eb51aca23dd5 2023-10-02 13:03:37,636 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/cf/bbcf6cfa8bdc4816b605631770422627 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/cf/bbcf6cfa8bdc4816b605631770422627 2023-10-02 13:03:37,639 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594/recovered.edits/9.seqid 2023-10-02 13:03:37,639 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a/recovered.edits/9.seqid 2023-10-02 13:03:37,640 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/eebc7a8f89251dd4b865e6b46a5a4594 2023-10-02 13:03:37,640 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testConsecutiveExports/92fbd32fffe039b78f481bb3a670c29a 2023-10-02 13:03:37,640 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-02 13:03:37,640 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-02 13:03:37,641 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-02 13:03:37,644 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100273839ec0b38842c2bbab98685d6a720b to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100273839ec0b38842c2bbab98685d6a720b 2023-10-02 13:03:37,646 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002e3ec0b1d62864e999681ad88321d0eee to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002e3ec0b1d62864e999681ad88321d0eee 2023-10-02 13:03:37,646 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-02 13:03:37,648 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 13:03:37,651 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-02 13:03:37,653 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-02 13:03:37,654 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 13:03:37,654 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-02 13:03:37,654 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251817654"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:37,654 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251817654"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:37,656 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 13:03:37,656 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => eebc7a8f89251dd4b865e6b46a5a4594, NAME => 'testtb-testConsecutiveExports,,1696251786767.eebc7a8f89251dd4b865e6b46a5a4594.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 92fbd32fffe039b78f481bb3a670c29a, NAME => 'testtb-testConsecutiveExports,1,1696251786767.92fbd32fffe039b78f481bb3a670c29a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 13:03:37,656 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-02 13:03:37,656 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696251817656"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:37,658 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-02 13:03:37,660 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 13:03:37,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 43 msec 2023-10-02 13:03:37,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-02 13:03:37,732 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-02 13:03:37,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-02 13:03:37,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-02 13:03:37,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-02 13:03:37,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-02 13:03:37,769 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 765), OpenFileDescriptor=903 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=233 (was 235), ProcessCount=167 (was 168), AvailableMemoryMB=1351 (was 1466) 2023-10-02 13:03:37,769 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-10-02 13:03:37,788 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=233, ProcessCount=167, AvailableMemoryMB=1350 2023-10-02 13:03:37,788 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-10-02 13:03:37,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 13:03:37,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:37,794 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 13:03:37,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-02 13:03:37,794 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 13:03:37,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 13:03:37,797 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:37,797 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992 2023-10-02 13:03:37,798 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55 empty. 2023-10-02 13:03:37,798 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992 empty. 2023-10-02 13:03:37,798 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:37,798 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992 2023-10-02 13:03:37,798 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-02 13:03:37,812 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-02 13:03:37,814 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 321c40603627c02e109164c26cdf2992, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:03:37,814 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => a21a7ea8181e469dc2996d72e5a18c55, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 321c40603627c02e109164c26cdf2992, disabling compactions & flushes 2023-10-02 13:03:37,832 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. after waiting 0 ms 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing a21a7ea8181e469dc2996d72e5a18c55, disabling compactions & flushes 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:37,832 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:37,832 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 321c40603627c02e109164c26cdf2992: 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. after waiting 0 ms 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:37,832 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:37,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for a21a7ea8181e469dc2996d72e5a18c55: 2023-10-02 13:03:37,835 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 13:03:37,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696251817836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251817836"}]},"ts":"1696251817836"} 2023-10-02 13:03:37,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696251817836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251817836"}]},"ts":"1696251817836"} 2023-10-02 13:03:37,842 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 13:03:37,843 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 13:03:37,843 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251817843"}]},"ts":"1696251817843"} 2023-10-02 13:03:37,844 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-02 13:03:37,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 13:03:37,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 13:03:37,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 13:03:37,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 13:03:37,854 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 13:03:37,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a21a7ea8181e469dc2996d72e5a18c55, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=321c40603627c02e109164c26cdf2992, ASSIGN}] 2023-10-02 13:03:37,857 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=321c40603627c02e109164c26cdf2992, ASSIGN 2023-10-02 13:03:37,857 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a21a7ea8181e469dc2996d72e5a18c55, ASSIGN 2023-10-02 13:03:37,858 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=321c40603627c02e109164c26cdf2992, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33895,1696251745577; forceNewPlan=false, retain=false 2023-10-02 13:03:37,858 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a21a7ea8181e469dc2996d72e5a18c55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46465,1696251745531; forceNewPlan=false, retain=false 2023-10-02 13:03:37,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 13:03:38,008 INFO [jenkins-hbase4:34719] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 13:03:38,011 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=321c40603627c02e109164c26cdf2992, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,011 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=a21a7ea8181e469dc2996d72e5a18c55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,011 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696251818011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251818011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251818011"}]},"ts":"1696251818011"} 2023-10-02 13:03:38,011 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696251818011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251818011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251818011"}]},"ts":"1696251818011"} 2023-10-02 13:03:38,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure a21a7ea8181e469dc2996d72e5a18c55, server=jenkins-hbase4.apache.org,46465,1696251745531}] 2023-10-02 13:03:38,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 321c40603627c02e109164c26cdf2992, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:03:38,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 13:03:38,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:38,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a21a7ea8181e469dc2996d72e5a18c55, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 13:03:38,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:38,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 321c40603627c02e109164c26cdf2992, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 13:03:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. service=AccessControlService 2023-10-02 13:03:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. service=AccessControlService 2023-10-02 13:03:38,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:03:38,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:03:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 321c40603627c02e109164c26cdf2992 2023-10-02 13:03:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 321c40603627c02e109164c26cdf2992 2023-10-02 13:03:38,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 321c40603627c02e109164c26cdf2992 2023-10-02 13:03:38,177 INFO [StoreOpener-a21a7ea8181e469dc2996d72e5a18c55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:38,177 INFO [StoreOpener-321c40603627c02e109164c26cdf2992-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 321c40603627c02e109164c26cdf2992 2023-10-02 13:03:38,179 DEBUG [StoreOpener-a21a7ea8181e469dc2996d72e5a18c55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/cf 2023-10-02 13:03:38,179 DEBUG [StoreOpener-a21a7ea8181e469dc2996d72e5a18c55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/cf 2023-10-02 13:03:38,179 DEBUG [StoreOpener-321c40603627c02e109164c26cdf2992-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/cf 2023-10-02 13:03:38,179 DEBUG [StoreOpener-321c40603627c02e109164c26cdf2992-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/cf 2023-10-02 13:03:38,180 INFO [StoreOpener-321c40603627c02e109164c26cdf2992-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 321c40603627c02e109164c26cdf2992 columnFamilyName cf 2023-10-02 13:03:38,180 INFO [StoreOpener-a21a7ea8181e469dc2996d72e5a18c55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a21a7ea8181e469dc2996d72e5a18c55 columnFamilyName cf 2023-10-02 13:03:38,182 INFO [StoreOpener-321c40603627c02e109164c26cdf2992-1] regionserver.HStore(310): Store=321c40603627c02e109164c26cdf2992/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:03:38,182 INFO [StoreOpener-a21a7ea8181e469dc2996d72e5a18c55-1] regionserver.HStore(310): Store=a21a7ea8181e469dc2996d72e5a18c55/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:03:38,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992 2023-10-02 13:03:38,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:38,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992 2023-10-02 13:03:38,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:38,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 321c40603627c02e109164c26cdf2992 2023-10-02 13:03:38,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:38,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:03:38,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 321c40603627c02e109164c26cdf2992; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63273179, jitterRate=-0.05715616047382355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:03:38,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 321c40603627c02e109164c26cdf2992: 2023-10-02 13:03:38,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:03:38,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992., pid=61, masterSystemTime=1696251818167 2023-10-02 13:03:38,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a21a7ea8181e469dc2996d72e5a18c55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71087464, jitterRate=0.059285759925842285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:03:38,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a21a7ea8181e469dc2996d72e5a18c55: 2023-10-02 13:03:38,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55., pid=60, masterSystemTime=1696251818166 2023-10-02 13:03:38,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:38,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:38,194 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=321c40603627c02e109164c26cdf2992, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:38,195 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696251818194"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251818194"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251818194"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251818194"}]},"ts":"1696251818194"} 2023-10-02 13:03:38,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:38,195 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=a21a7ea8181e469dc2996d72e5a18c55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,195 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696251818195"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251818195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251818195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251818195"}]},"ts":"1696251818195"} 2023-10-02 13:03:38,199 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-02 13:03:38,199 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 321c40603627c02e109164c26cdf2992, server=jenkins-hbase4.apache.org,33895,1696251745577 in 183 msec 2023-10-02 13:03:38,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-02 13:03:38,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure a21a7ea8181e469dc2996d72e5a18c55, server=jenkins-hbase4.apache.org,46465,1696251745531 in 185 msec 2023-10-02 13:03:38,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=321c40603627c02e109164c26cdf2992, ASSIGN in 344 msec 2023-10-02 13:03:38,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-10-02 13:03:38,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a21a7ea8181e469dc2996d72e5a18c55, ASSIGN in 344 msec 2023-10-02 13:03:38,202 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 13:03:38,202 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251818202"}]},"ts":"1696251818202"} 2023-10-02 13:03:38,203 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-02 13:03:38,205 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 13:03:38,205 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-02 13:03:38,208 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 13:03:38,209 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:38,209 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:38,209 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:38,209 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:38,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:38,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:38,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:38,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:38,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 420 msec 2023-10-02 13:03:38,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 13:03:38,399 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-02 13:03:38,401 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,401 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:38,403 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:03:38,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 13:03:38,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251818422 (current time:1696251818422). 2023-10-02 13:03:38,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:03:38,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x37c295b7 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:38,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17a8ec5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:38,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:38,434 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:38,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37c295b7 to 127.0.0.1:55009 2023-10-02 13:03:38,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:38,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x1b0666a0 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:38,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38ca275a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:38,442 DEBUG [hconnection-0x68d0f613-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:38,443 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:38,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:38,449 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:38,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b0666a0 to 127.0.0.1:55009 2023-10-02 13:03:38,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:38,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 13:03:38,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:03:38,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 13:03:38,455 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:03:38,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 13:03:38,457 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 13:03:38,458 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696252418458 2023-10-02 13:03:38,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 13:03:38,458 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,459 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:03:38,459 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:03:38,460 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 13:03:38,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 13:03:38,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-02 13:03:38,462 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 13:03:38,462 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696252418462 2023-10-02 13:03:38,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,471 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-02 13:03:38,471 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:38,473 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-02 13:03:38,473 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-02 13:03:38,473 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,473 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,475 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,475 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,475 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,475 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,476 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,476 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,477 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,477 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:03:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 13:03:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,477 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 13:03:38,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,477 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 13:03:38,477 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:38,479 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 13:03:38,479 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 13:03:38,479 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 13:03:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 13:03:38,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 13:03:38,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,480 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 13:03:38,480 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:38,481 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 13:03:38,481 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 13:03:38,481 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 13:03:38,481 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 13:03:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,481 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,482 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 13:03:38,482 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,482 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:38,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,482 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 13:03:38,482 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:38,483 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 13:03:38,483 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 13:03:38,483 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 13:03:38,483 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:38,485 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,485 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,485 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,485 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 13:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8f62028[Count = 1] remaining members to acquire global barrier 2023-10-02 13:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:38,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 13:03:38,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8f62028[Count = 0] remaining members to acquire global barrier 2023-10-02 13:03:38,488 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-02 13:03:38,488 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,490 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,490 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,490 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,490 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 13:03:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 13:03:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 13:03:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:38,490 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,490 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 13:03:38,491 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. started... 2023-10-02 13:03:38,491 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:03:38,491 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:38,490 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:03:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:38,491 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:38,491 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a21a7ea8181e469dc2996d72e5a18c55: 2023-10-02 13:03:38,491 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. started... 2023-10-02 13:03:38,491 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,492 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 321c40603627c02e109164c26cdf2992: 2023-10-02 13:03:38,492 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:38,492 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:03:38,492 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,492 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:38,492 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:03:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 13:03:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 13:03:38,504 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. completed. 2023-10-02 13:03:38,504 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:38,505 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:38,505 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:38,505 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,505 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. completed. 2023-10-02 13:03:38,505 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 13:03:38,505 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:38,505 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:03:38,505 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:38,505 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:38,505 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,505 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 13:03:38,505 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:03:38,506 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 13:03:38,506 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,506 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,506 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 13:03:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:38,508 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,508 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 13:03:38,508 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:38,508 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 13:03:38,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:38,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:38,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46465,1696251745531': 2023-10-02 13:03:38,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-02 13:03:38,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:38,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:38,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:38,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:38,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:38,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33895,1696251745577': 2023-10-02 13:03:38,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-02 13:03:38,515 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-02 13:03:38,515 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:03:38,515 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:03:38,515 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,515 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:03:38,518 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,518 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:38,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,518 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,518 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,519 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,519 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,521 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:38,521 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,522 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,524 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,524 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,524 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,524 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,525 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,525 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,525 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,524 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,525 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,525 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,524 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:38,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,525 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,525 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,527 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:03:38,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,527 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,527 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,527 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,527 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,527 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,527 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 13:03:38,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,559 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:38,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 13:03:38,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:03:38,560 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-02 13:03:38,560 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:03:38,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,561 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696251818458Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696251818538 (+80 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696251818538Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696251818538Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696251818542 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696251818554 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696251818560 (+6 ms) 2023-10-02 13:03:38,563 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 13:03:38,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 104 msec 2023-10-02 13:03:38,760 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:38,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 13:03:38,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:03:38,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46465] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:03:38,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33895] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:03:38,768 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,768 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:38,768 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:03:38,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 13:03:38,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251818778 (current time:1696251818778). 2023-10-02 13:03:38,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:03:38,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x41845f79 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:38,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13a01d98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:38,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:38,789 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:38,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41845f79 to 127.0.0.1:55009 2023-10-02 13:03:38,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:38,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x658e87a5 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:38,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61263fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:38,799 DEBUG [hconnection-0x15cde27d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:38,802 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:38,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:38,808 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:38,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x658e87a5 to 127.0.0.1:55009 2023-10-02 13:03:38,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:38,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 13:03:38,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:03:38,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 13:03:38,812 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:03:38,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 13:03:38,815 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 13:03:38,815 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696252418815 2023-10-02 13:03:38,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 13:03:38,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,816 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:03:38,817 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:03:38,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 13:03:38,817 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 13:03:38,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-02 13:03:38,819 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 13:03:38,820 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696252418820 2023-10-02 13:03:38,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,828 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-02 13:03:38,828 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:38,829 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-02 13:03:38,829 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-02 13:03:38,830 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,830 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,831 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,831 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,831 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,831 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,831 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,831 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,832 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,832 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:03:38,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 13:03:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 13:03:38,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 13:03:38,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,833 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 13:03:38,833 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 13:03:38,833 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 13:03:38,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,833 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 13:03:38,833 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 13:03:38,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,833 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:38,833 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 13:03:38,834 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 13:03:38,834 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:38,833 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:38,835 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 13:03:38,836 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 13:03:38,836 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 13:03:38,834 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 13:03:38,836 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 13:03:38,836 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 13:03:38,836 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 13:03:38,837 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 13:03:38,838 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,839 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,839 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,840 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,840 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:38,840 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,840 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:38,840 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,840 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:38,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:38,840 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,840 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:38,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:38,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:38,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:38,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 13:03:38,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24d67560[Count = 1] remaining members to acquire global barrier 2023-10-02 13:03:38,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:38,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:38,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:38,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:38,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:38,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 13:03:38,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24d67560[Count = 0] remaining members to acquire global barrier 2023-10-02 13:03:38,844 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-02 13:03:38,844 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,845 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,845 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,845 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,845 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 13:03:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,845 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,845 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 13:03:38,845 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 13:03:38,845 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 13:03:38,845 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:03:38,845 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,845 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:03:38,845 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:38,845 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:38,845 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:38,845 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:38,846 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:38,846 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. started... 2023-10-02 13:03:38,846 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:38,846 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. started... 2023-10-02 13:03:38,846 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 321c40603627c02e109164c26cdf2992 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-02 13:03:38,846 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a21a7ea8181e469dc2996d72e5a18c55 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-02 13:03:38,846 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 13:03:38,846 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:38,847 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 13:03:38,863 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100272125b2bc6944ab993da881bdab642ba to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100272125b2bc6944ab993da881bdab642ba 2023-10-02 13:03:38,864 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100272746c4e8dc144f3928aab5ab561af08 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023100272746c4e8dc144f3928aab5ab561af08 2023-10-02 13:03:38,875 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/.tmp/cf/600b66411aee4aafba21abf118c221cd 2023-10-02 13:03:38,875 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/.tmp/cf/963605afe1a6446c8f2b8ec57c77e0b4 2023-10-02 13:03:38,880 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/.tmp/cf/963605afe1a6446c8f2b8ec57c77e0b4 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/cf/963605afe1a6446c8f2b8ec57c77e0b4 2023-10-02 13:03:38,880 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/.tmp/cf/600b66411aee4aafba21abf118c221cd as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/cf/600b66411aee4aafba21abf118c221cd 2023-10-02 13:03:38,885 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/cf/963605afe1a6446c8f2b8ec57c77e0b4, entries=45, sequenceid=6, filesize=13.2 K 2023-10-02 13:03:38,885 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/cf/600b66411aee4aafba21abf118c221cd, entries=5, sequenceid=6, filesize=5.8 K 2023-10-02 13:03:38,886 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 321c40603627c02e109164c26cdf2992 in 40ms, sequenceid=6, compaction requested=false 2023-10-02 13:03:38,886 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-02 13:03:38,886 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for a21a7ea8181e469dc2996d72e5a18c55 in 40ms, sequenceid=6, compaction requested=false 2023-10-02 13:03:38,886 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-02 13:03:38,889 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 321c40603627c02e109164c26cdf2992: 2023-10-02 13:03:38,889 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a21a7ea8181e469dc2996d72e5a18c55: 2023-10-02 13:03:38,889 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,889 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,889 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:38,889 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:38,889 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/cf/963605afe1a6446c8f2b8ec57c77e0b4] hfiles 2023-10-02 13:03:38,889 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/cf/600b66411aee4aafba21abf118c221cd] hfiles 2023-10-02 13:03:38,889 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/cf/600b66411aee4aafba21abf118c221cd for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,889 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/cf/963605afe1a6446c8f2b8ec57c77e0b4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,898 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. completed. 2023-10-02 13:03:38,898 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:38,898 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:38,898 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:38,898 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,898 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 13:03:38,898 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:03:38,898 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. completed. 2023-10-02 13:03:38,898 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:38,898 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:38,899 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:38,899 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,899 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 13:03:38,899 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:03:38,900 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 13:03:38,900 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,900 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:38,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:38,900 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 13:03:38,903 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,903 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 13:03:38,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:38,903 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:38,903 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 13:03:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46465,1696251745531': 2023-10-02 13:03:38,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-02 13:03:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33895,1696251745577': 2023-10-02 13:03:38,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-02 13:03:38,910 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-02 13:03:38,910 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:03:38,910 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:03:38,910 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,910 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:03:38,914 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,914 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,914 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,914 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:38,914 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,915 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,914 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,914 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,915 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,916 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:38,917 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,918 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 13:03:38,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:03:38,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,918 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,918 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:03:38,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:38,918 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,921 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,921 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:38,921 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:38,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,923 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,923 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:03:38,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:38,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:38,921 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:38,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,923 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:38,924 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,924 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:38,924 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:38,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:38,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:38,924 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,924 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100272125b2bc6944ab993da881bdab642ba, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023100272746c4e8dc144f3928aab5ab561af08] mob files 2023-10-02 13:03:38,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100272125b2bc6944ab993da881bdab642ba 2023-10-02 13:03:38,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023100272746c4e8dc144f3928aab5ab561af08 2023-10-02 13:03:38,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-02 13:03:38,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,949 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:38,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696251818815Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696251818931 (+116 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696251818931Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696251818931Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696251818934 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696251818941 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696251818949 (+8 ms) 2023-10-02 13:03:38,952 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 13:03:38,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 136 msec 2023-10-02 13:03:39,118 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:39,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 13:03:39,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:03:39,149 DEBUG [Listener at jenkins-hbase4.apache.org/39417] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 13:03:39,152 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 13:03:39,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33895] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 13:03:39,154 DEBUG [Listener at jenkins-hbase4.apache.org/39417] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 13:03:39,157 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 13:03:39,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46465] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 13:03:39,158 DEBUG [Listener at jenkins-hbase4.apache.org/39417] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 13:03:39,161 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 13:03:39,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46551] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 13:03:39,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-02 13:03:39,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:39,166 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 13:03:39,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-02 13:03:39,167 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 13:03:39,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 13:03:39,169 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:39,169 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,170 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b empty. 2023-10-02 13:03:39,170 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e empty. 2023-10-02 13:03:39,170 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:39,170 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,170 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-02 13:03:39,180 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-02 13:03:39,181 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 81f912cc2d52b64271b67c58d2878a3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:03:39,182 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 36740dad0238116bff938d56824dbf3e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:03:39,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:39,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 81f912cc2d52b64271b67c58d2878a3b, disabling compactions & flushes 2023-10-02 13:03:39,191 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:39,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:39,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. after waiting 0 ms 2023-10-02 13:03:39,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:39,191 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:39,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 81f912cc2d52b64271b67c58d2878a3b: 2023-10-02 13:03:39,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:39,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 36740dad0238116bff938d56824dbf3e, disabling compactions & flushes 2023-10-02 13:03:39,191 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:39,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:39,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. after waiting 0 ms 2023-10-02 13:03:39,192 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:39,192 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:39,192 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 36740dad0238116bff938d56824dbf3e: 2023-10-02 13:03:39,194 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 13:03:39,195 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696251819194"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251819194"}]},"ts":"1696251819194"} 2023-10-02 13:03:39,195 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696251819194"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251819194"}]},"ts":"1696251819194"} 2023-10-02 13:03:39,197 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 13:03:39,197 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 13:03:39,198 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251819198"}]},"ts":"1696251819198"} 2023-10-02 13:03:39,199 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-02 13:03:39,203 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 13:03:39,204 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 13:03:39,204 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 13:03:39,204 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 13:03:39,204 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 13:03:39,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81f912cc2d52b64271b67c58d2878a3b, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36740dad0238116bff938d56824dbf3e, ASSIGN}] 2023-10-02 13:03:39,207 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36740dad0238116bff938d56824dbf3e, ASSIGN 2023-10-02 13:03:39,207 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81f912cc2d52b64271b67c58d2878a3b, ASSIGN 2023-10-02 13:03:39,208 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36740dad0238116bff938d56824dbf3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33895,1696251745577; forceNewPlan=false, retain=false 2023-10-02 13:03:39,208 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81f912cc2d52b64271b67c58d2878a3b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46551,1696251745482; forceNewPlan=false, retain=false 2023-10-02 13:03:39,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 13:03:39,358 INFO [jenkins-hbase4:34719] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 13:03:39,361 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=81f912cc2d52b64271b67c58d2878a3b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:39,361 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=36740dad0238116bff938d56824dbf3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:39,361 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696251819361"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251819361"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251819361"}]},"ts":"1696251819361"} 2023-10-02 13:03:39,361 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696251819361"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251819361"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251819361"}]},"ts":"1696251819361"} 2023-10-02 13:03:39,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 81f912cc2d52b64271b67c58d2878a3b, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:03:39,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 36740dad0238116bff938d56824dbf3e, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:03:39,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 13:03:39,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:39,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81f912cc2d52b64271b67c58d2878a3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b.', STARTKEY => '', ENDKEY => '2'} 2023-10-02 13:03:39,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:39,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 36740dad0238116bff938d56824dbf3e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e.', STARTKEY => '2', ENDKEY => ''} 2023-10-02 13:03:39,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. service=AccessControlService 2023-10-02 13:03:39,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. service=AccessControlService 2023-10-02 13:03:39,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:03:39,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:03:39,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:39,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:39,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:39,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:39,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:39,521 INFO [StoreOpener-36740dad0238116bff938d56824dbf3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,521 INFO [StoreOpener-81f912cc2d52b64271b67c58d2878a3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:39,522 DEBUG [StoreOpener-36740dad0238116bff938d56824dbf3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/cf 2023-10-02 13:03:39,522 DEBUG [StoreOpener-81f912cc2d52b64271b67c58d2878a3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/cf 2023-10-02 13:03:39,522 DEBUG [StoreOpener-36740dad0238116bff938d56824dbf3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/cf 2023-10-02 13:03:39,522 DEBUG [StoreOpener-81f912cc2d52b64271b67c58d2878a3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/cf 2023-10-02 13:03:39,523 INFO [StoreOpener-36740dad0238116bff938d56824dbf3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36740dad0238116bff938d56824dbf3e columnFamilyName cf 2023-10-02 13:03:39,523 INFO [StoreOpener-81f912cc2d52b64271b67c58d2878a3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81f912cc2d52b64271b67c58d2878a3b columnFamilyName cf 2023-10-02 13:03:39,523 INFO [StoreOpener-36740dad0238116bff938d56824dbf3e-1] regionserver.HStore(310): Store=36740dad0238116bff938d56824dbf3e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:03:39,523 INFO [StoreOpener-81f912cc2d52b64271b67c58d2878a3b-1] regionserver.HStore(310): Store=81f912cc2d52b64271b67c58d2878a3b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:03:39,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:39,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:39,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:39,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:03:39,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:03:39,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 36740dad0238116bff938d56824dbf3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64426923, jitterRate=-0.03996403515338898}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:03:39,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 81f912cc2d52b64271b67c58d2878a3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69160823, jitterRate=0.030576571822166443}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:03:39,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 36740dad0238116bff938d56824dbf3e: 2023-10-02 13:03:39,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 81f912cc2d52b64271b67c58d2878a3b: 2023-10-02 13:03:39,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e., pid=70, masterSystemTime=1696251819516 2023-10-02 13:03:39,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b., pid=69, masterSystemTime=1696251819515 2023-10-02 13:03:39,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:39,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:39,532 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=36740dad0238116bff938d56824dbf3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:39,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:39,532 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696251819532"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251819532"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251819532"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251819532"}]},"ts":"1696251819532"} 2023-10-02 13:03:39,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:39,533 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=81f912cc2d52b64271b67c58d2878a3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:39,533 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696251819533"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251819533"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251819533"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251819533"}]},"ts":"1696251819533"} 2023-10-02 13:03:39,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-10-02 13:03:39,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 36740dad0238116bff938d56824dbf3e, server=jenkins-hbase4.apache.org,33895,1696251745577 in 170 msec 2023-10-02 13:03:39,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-02 13:03:39,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 81f912cc2d52b64271b67c58d2878a3b, server=jenkins-hbase4.apache.org,46551,1696251745482 in 171 msec 2023-10-02 13:03:39,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36740dad0238116bff938d56824dbf3e, ASSIGN in 332 msec 2023-10-02 13:03:39,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-02 13:03:39,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81f912cc2d52b64271b67c58d2878a3b, ASSIGN in 333 msec 2023-10-02 13:03:39,539 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 13:03:39,539 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251819539"}]},"ts":"1696251819539"} 2023-10-02 13:03:39,540 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-02 13:03:39,542 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 13:03:39,543 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-02 13:03:39,544 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-02 13:03:39,546 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:39,546 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:39,546 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:39,546 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:39,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:39,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:39,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:39,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:39,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:39,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:39,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:39,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:39,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 384 msec 2023-10-02 13:03:39,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 13:03:39,771 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-02 13:03:39,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 81f912cc2d52b64271b67c58d2878a3b, 36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[81f912cc2d52b64271b67c58d2878a3b, 36740dad0238116bff938d56824dbf3e], force=true 2023-10-02 13:03:39,801 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[81f912cc2d52b64271b67c58d2878a3b, 36740dad0238116bff938d56824dbf3e], force=true 2023-10-02 13:03:39,802 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[81f912cc2d52b64271b67c58d2878a3b, 36740dad0238116bff938d56824dbf3e], force=true 2023-10-02 13:03:39,802 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[81f912cc2d52b64271b67c58d2878a3b, 36740dad0238116bff938d56824dbf3e], force=true 2023-10-02 13:03:39,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 13:03:39,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81f912cc2d52b64271b67c58d2878a3b, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36740dad0238116bff938d56824dbf3e, UNASSIGN}] 2023-10-02 13:03:39,826 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36740dad0238116bff938d56824dbf3e, UNASSIGN 2023-10-02 13:03:39,826 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81f912cc2d52b64271b67c58d2878a3b, UNASSIGN 2023-10-02 13:03:39,827 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=36740dad0238116bff938d56824dbf3e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:39,827 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=81f912cc2d52b64271b67c58d2878a3b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:39,827 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696251819827"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251819827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251819827"}]},"ts":"1696251819827"} 2023-10-02 13:03:39,827 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696251819827"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251819827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251819827"}]},"ts":"1696251819827"} 2023-10-02 13:03:39,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 36740dad0238116bff938d56824dbf3e, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:03:39,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 81f912cc2d52b64271b67c58d2878a3b, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:03:39,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 13:03:39,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:39,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 36740dad0238116bff938d56824dbf3e, disabling compactions & flushes 2023-10-02 13:03:39,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:39,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:39,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. after waiting 0 ms 2023-10-02 13:03:39,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:39,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 36740dad0238116bff938d56824dbf3e 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-02 13:03:39,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:39,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 81f912cc2d52b64271b67c58d2878a3b, disabling compactions & flushes 2023-10-02 13:03:39,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:39,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:39,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. after waiting 0 ms 2023-10-02 13:03:39,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:39,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 81f912cc2d52b64271b67c58d2878a3b 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-02 13:03:39,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/.tmp/cf/c791c74b235d4b3aacdf779fc57c37bf 2023-10-02 13:03:39,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/.tmp/cf/6a7a154c71614528860b014702f87175 2023-10-02 13:03:40,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/.tmp/cf/c791c74b235d4b3aacdf779fc57c37bf as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/cf/c791c74b235d4b3aacdf779fc57c37bf 2023-10-02 13:03:40,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/.tmp/cf/6a7a154c71614528860b014702f87175 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/cf/6a7a154c71614528860b014702f87175 2023-10-02 13:03:40,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/cf/c791c74b235d4b3aacdf779fc57c37bf, entries=1, sequenceid=5, filesize=4.7 K 2023-10-02 13:03:40,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 36740dad0238116bff938d56824dbf3e in 24ms, sequenceid=5, compaction requested=false 2023-10-02 13:03:40,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-02 13:03:40,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/cf/6a7a154c71614528860b014702f87175, entries=1, sequenceid=5, filesize=4.7 K 2023-10-02 13:03:40,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 81f912cc2d52b64271b67c58d2878a3b in 23ms, sequenceid=5, compaction requested=false 2023-10-02 13:03:40,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-02 13:03:40,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-02 13:03:40,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:03:40,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e. 2023-10-02 13:03:40,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 36740dad0238116bff938d56824dbf3e: 2023-10-02 13:03:40,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:03:40,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b. 2023-10-02 13:03:40,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 81f912cc2d52b64271b67c58d2878a3b: 2023-10-02 13:03:40,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:40,023 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=36740dad0238116bff938d56824dbf3e, regionState=CLOSED 2023-10-02 13:03:40,024 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696251820023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251820023"}]},"ts":"1696251820023"} 2023-10-02 13:03:40,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:40,024 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=81f912cc2d52b64271b67c58d2878a3b, regionState=CLOSED 2023-10-02 13:03:40,024 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696251820024"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251820024"}]},"ts":"1696251820024"} 2023-10-02 13:03:40,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-02 13:03:40,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 36740dad0238116bff938d56824dbf3e, server=jenkins-hbase4.apache.org,33895,1696251745577 in 197 msec 2023-10-02 13:03:40,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-02 13:03:40,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 81f912cc2d52b64271b67c58d2878a3b, server=jenkins-hbase4.apache.org,46551,1696251745482 in 197 msec 2023-10-02 13:03:40,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=36740dad0238116bff938d56824dbf3e, UNASSIGN in 203 msec 2023-10-02 13:03:40,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-02 13:03:40,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81f912cc2d52b64271b67c58d2878a3b, UNASSIGN in 207 msec 2023-10-02 13:03:40,077 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-02 13:03:40,079 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819162.81f912cc2d52b64271b67c58d2878a3b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:40,079 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696251819162.36740dad0238116bff938d56824dbf3e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:40,079 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:40,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 13:03:40,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9312f993a08bf73230f500a698f7fcff, ASSIGN}] 2023-10-02 13:03:40,130 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9312f993a08bf73230f500a698f7fcff, ASSIGN 2023-10-02 13:03:40,131 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9312f993a08bf73230f500a698f7fcff, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46551,1696251745482; forceNewPlan=false, retain=false 2023-10-02 13:03:40,281 INFO [jenkins-hbase4:34719] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 13:03:40,283 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9312f993a08bf73230f500a698f7fcff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,283 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696251820283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251820283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251820283"}]},"ts":"1696251820283"} 2023-10-02 13:03:40,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 9312f993a08bf73230f500a698f7fcff, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:03:40,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 13:03:40,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. 2023-10-02 13:03:40,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9312f993a08bf73230f500a698f7fcff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.', STARTKEY => '', ENDKEY => ''} 2023-10-02 13:03:40,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. service=AccessControlService 2023-10-02 13:03:40,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:03:40,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:40,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:40,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:40,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:40,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/.regioninfo 2023-10-02 13:03:40,450 INFO [StoreOpener-9312f993a08bf73230f500a698f7fcff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:40,451 DEBUG [StoreOpener-9312f993a08bf73230f500a698f7fcff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf 2023-10-02 13:03:40,451 DEBUG [StoreOpener-9312f993a08bf73230f500a698f7fcff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf 2023-10-02 13:03:40,451 INFO [StoreOpener-9312f993a08bf73230f500a698f7fcff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9312f993a08bf73230f500a698f7fcff columnFamilyName cf 2023-10-02 13:03:40,479 DEBUG [StoreOpener-9312f993a08bf73230f500a698f7fcff-1] regionserver.HStore(539): loaded hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf/6a7a154c71614528860b014702f87175.81f912cc2d52b64271b67c58d2878a3b->hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/cf/6a7a154c71614528860b014702f87175-top 2023-10-02 13:03:40,484 DEBUG [StoreOpener-9312f993a08bf73230f500a698f7fcff-1] regionserver.HStore(539): loaded hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf/c791c74b235d4b3aacdf779fc57c37bf.36740dad0238116bff938d56824dbf3e->hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/cf/c791c74b235d4b3aacdf779fc57c37bf-top 2023-10-02 13:03:40,485 INFO [StoreOpener-9312f993a08bf73230f500a698f7fcff-1] regionserver.HStore(310): Store=9312f993a08bf73230f500a698f7fcff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:03:40,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:40,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:40,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:40,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9312f993a08bf73230f500a698f7fcff; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66831702, jitterRate=-0.004130035638809204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:03:40,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9312f993a08bf73230f500a698f7fcff: 2023-10-02 13:03:40,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff., pid=77, masterSystemTime=1696251820436 2023-10-02 13:03:40,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.,because compaction is disabled. 2023-10-02 13:03:40,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. 2023-10-02 13:03:40,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. 2023-10-02 13:03:40,494 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9312f993a08bf73230f500a698f7fcff, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,494 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696251820493"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251820493"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251820493"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251820493"}]},"ts":"1696251820493"} 2023-10-02 13:03:40,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-02 13:03:40,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 9312f993a08bf73230f500a698f7fcff, server=jenkins-hbase4.apache.org,46551,1696251745482 in 210 msec 2023-10-02 13:03:40,498 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-02 13:03:40,498 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9312f993a08bf73230f500a698f7fcff, ASSIGN in 368 msec 2023-10-02 13:03:40,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[81f912cc2d52b64271b67c58d2878a3b, 36740dad0238116bff938d56824dbf3e], force=true in 703 msec 2023-10-02 13:03:40,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 13:03:40,909 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-02 13:03:40,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 13:03:40,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251820910 (current time:1696251820910). 2023-10-02 13:03:40,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:03:40,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x49223869 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:40,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75977461, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:40,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:40,921 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:40,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49223869 to 127.0.0.1:55009 2023-10-02 13:03:40,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:40,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x3c3f5830 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:40,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6486ceae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:40,930 DEBUG [hconnection-0x2afc8a23-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:40,932 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:40,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:40,938 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:40,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c3f5830 to 127.0.0.1:55009 2023-10-02 13:03:40,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:40,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-02 13:03:40,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:03:40,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 13:03:40,942 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:03:40,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 13:03:40,944 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 13:03:40,945 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696252420945 2023-10-02 13:03:40,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 13:03:40,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,948 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:03:40,948 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:03:40,949 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 13:03:40,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 13:03:40,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-10-02 13:03:40,951 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 13:03:40,952 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696252420952 2023-10-02 13:03:40,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,960 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-02 13:03:40,960 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:40,961 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-02 13:03:40,961 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-02 13:03:40,962 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,962 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,963 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:40,963 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:40,963 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:40,963 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:40,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:40,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:40,963 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,963 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:03:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,964 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 13:03:40,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,965 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 13:03:40,965 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 13:03:40,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,965 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:40,965 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 13:03:40,966 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:40,965 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:40,967 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 13:03:40,968 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 13:03:40,968 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 13:03:40,966 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 13:03:40,968 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 13:03:40,968 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 13:03:40,968 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 13:03:40,968 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 13:03:40,968 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 13:03:40,970 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,970 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,971 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,971 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,971 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,971 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:40,971 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,971 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:40,971 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,971 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:40,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:40,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:40,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:40,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:40,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-02 13:03:40,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f95cccb[Count = 0] remaining members to acquire global barrier 2023-10-02 13:03:40,973 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-02 13:03:40,973 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,975 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,975 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,975 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,976 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,976 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 13:03:40,976 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 13:03:40,976 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 13:03:40,976 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 13:03:40,976 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:03:40,976 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:03:40,976 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 13:03:40,976 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:03:40,976 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:40,976 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:40,976 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. 2023-10-02 13:03:40,976 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. started... 2023-10-02 13:03:40,978 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9312f993a08bf73230f500a698f7fcff: 2023-10-02 13:03:40,978 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,978 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:40,978 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf/6a7a154c71614528860b014702f87175.81f912cc2d52b64271b67c58d2878a3b->hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/cf/6a7a154c71614528860b014702f87175-top, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf/c791c74b235d4b3aacdf779fc57c37bf.36740dad0238116bff938d56824dbf3e->hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/cf/c791c74b235d4b3aacdf779fc57c37bf-top] hfiles 2023-10-02 13:03:40,978 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf/6a7a154c71614528860b014702f87175.81f912cc2d52b64271b67c58d2878a3b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,979 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 13:03:40,979 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 13:03:40,979 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:40,979 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf/c791c74b235d4b3aacdf779fc57c37bf.36740dad0238116bff938d56824dbf3e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,979 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:40,979 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 13:03:40,980 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 13:03:40,990 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. completed. 2023-10-02 13:03:40,990 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. 2023-10-02 13:03:40,990 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:40,990 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:40,990 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,990 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 13:03:40,990 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:03:40,995 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 13:03:40,995 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,995 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:40,995 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 13:03:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:40,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:40,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:40,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46551,1696251745482': 2023-10-02 13:03:40,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-02 13:03:40,999 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-02 13:03:40,999 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:03:40,999 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:03:40,999 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:40,999 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:03:41,000 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,000 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:41,000 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:41,000 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,000 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,001 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:41,001 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:41,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:41,001 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:41,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,002 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:41,002 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:41,004 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,004 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:41,005 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:41,007 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:41,007 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,007 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:41,007 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:41,007 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:41,007 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:41,008 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:41,007 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:41,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:41,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:41,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:41,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:41,008 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:41,008 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:41,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,008 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:41,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,008 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:41,008 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:41,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:41,008 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,008 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:41,008 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:41,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:41,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:41,008 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:41,008 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:41,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:41,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:41,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,030 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-02 13:03:41,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,031 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696251820945Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696251821008 (+63 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696251821008Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696251821011 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696251821021 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696251821030 (+9 ms) 2023-10-02 13:03:41,034 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 13:03:41,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 86 msec 2023-10-02 13:03:41,049 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:41,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-02 13:03:41,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:03:41,050 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251821050 2023-10-02 13:03:41,050 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35861, tgtDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251821050, rawTgtDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251821050, srcFsUri=hdfs://localhost:35861, srcDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:03:41,072 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:03:41,072 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-208479884_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251821050, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251821050/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,072 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c, snapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-02 13:03:41,081 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251821050/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:41,101 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:41,101 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:41,102 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:41,102 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:41,622 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0004_000001 (auth:SIMPLE) 2023-10-02 13:03:42,003 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-7409129744638124427.jar 2023-10-02 13:03:42,004 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:42,004 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:42,072 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-8251714688307679039.jar 2023-10-02 13:03:42,072 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:42,073 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:42,073 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:42,073 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:42,074 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:42,074 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:42,074 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 13:03:42,075 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 13:03:42,075 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 13:03:42,075 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 13:03:42,076 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 13:03:42,076 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 13:03:42,077 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 13:03:42,077 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 13:03:42,077 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 13:03:42,078 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 13:03:42,078 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:42,079 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:42,079 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:42,079 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:42,080 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:42,080 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:42,081 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:42,448 WARN [Listener at jenkins-hbase4.apache.org/39417] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 13:03:42,450 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-02 13:03:42,452 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-02 13:03:42,507 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:03:42,507 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:03:42,626 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0005_000001 (auth:SIMPLE) 2023-10-02 13:03:43,071 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 13:03:46,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0005_000001 (auth:SIMPLE) 2023-10-02 13:03:48,633 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0005_000001 (auth:SIMPLE) 2023-10-02 13:03:50,990 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0005_000001 (auth:SIMPLE) 2023-10-02 13:03:52,621 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 13:03:52,626 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 13:03:52,636 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,636 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 13:03:52,636 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 13:03:52,637 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,637 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-02 13:03:52,637 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-02 13:03:52,637 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251821050/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251821050/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,638 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251821050/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-02 13:03:52,638 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251821050/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-02 13:03:52,644 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 13:03:52,648 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251832648"}]},"ts":"1696251832648"} 2023-10-02 13:03:52,649 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-02 13:03:52,651 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-02 13:03:52,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9312f993a08bf73230f500a698f7fcff, UNASSIGN}] 2023-10-02 13:03:52,653 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9312f993a08bf73230f500a698f7fcff, UNASSIGN 2023-10-02 13:03:52,654 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9312f993a08bf73230f500a698f7fcff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:52,654 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696251832654"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251832654"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251832654"}]},"ts":"1696251832654"} 2023-10-02 13:03:52,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 9312f993a08bf73230f500a698f7fcff, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:03:52,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 13:03:52,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:52,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9312f993a08bf73230f500a698f7fcff, disabling compactions & flushes 2023-10-02 13:03:52,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. 2023-10-02 13:03:52,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. 2023-10-02 13:03:52,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. after waiting 0 ms 2023-10-02 13:03:52,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. 2023-10-02 13:03:52,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-02 13:03:52,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:03:52,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff. 2023-10-02 13:03:52,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9312f993a08bf73230f500a698f7fcff: 2023-10-02 13:03:52,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:52,824 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9312f993a08bf73230f500a698f7fcff, regionState=CLOSED 2023-10-02 13:03:52,824 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696251832824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251832824"}]},"ts":"1696251832824"} 2023-10-02 13:03:52,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-02 13:03:52,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 9312f993a08bf73230f500a698f7fcff, server=jenkins-hbase4.apache.org,46551,1696251745482 in 171 msec 2023-10-02 13:03:52,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-02 13:03:52,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9312f993a08bf73230f500a698f7fcff, UNASSIGN in 176 msec 2023-10-02 13:03:52,829 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251832829"}]},"ts":"1696251832829"} 2023-10-02 13:03:52,830 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-02 13:03:52,832 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-02 13:03:52,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 188 msec 2023-10-02 13:03:52,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 13:03:52,951 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-02 13:03:52,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,954 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,955 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,956 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,959 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,959 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:52,959 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,959 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,959 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,959 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:52,959 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:52,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 13:03:52,960 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:52,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-02 13:03:52,961 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,961 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 13:03:52,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-02 13:03:52,961 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 13:03:52,960 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:52,960 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:52,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-02 13:03:52,961 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:52,961 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 13:03:52,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-02 13:03:52,962 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/recovered.edits] 2023-10-02 13:03:52,962 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/recovered.edits] 2023-10-02 13:03:52,963 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/recovered.edits] 2023-10-02 13:03:52,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:52,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:52,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:52,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:52,967 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/cf/6a7a154c71614528860b014702f87175 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/cf/6a7a154c71614528860b014702f87175 2023-10-02 13:03:52,967 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/cf/c791c74b235d4b3aacdf779fc57c37bf to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/cf/c791c74b235d4b3aacdf779fc57c37bf 2023-10-02 13:03:52,967 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf/6a7a154c71614528860b014702f87175.81f912cc2d52b64271b67c58d2878a3b to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf/6a7a154c71614528860b014702f87175.81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:52,969 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf/c791c74b235d4b3aacdf779fc57c37bf.36740dad0238116bff938d56824dbf3e to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/cf/c791c74b235d4b3aacdf779fc57c37bf.36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:52,970 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/recovered.edits/8.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b/recovered.edits/8.seqid 2023-10-02 13:03:52,970 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/recovered.edits/8.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e/recovered.edits/8.seqid 2023-10-02 13:03:52,971 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81f912cc2d52b64271b67c58d2878a3b 2023-10-02 13:03:52,971 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/36740dad0238116bff938d56824dbf3e 2023-10-02 13:03:52,972 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/recovered.edits/12.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff/recovered.edits/12.seqid 2023-10-02 13:03:52,972 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9312f993a08bf73230f500a698f7fcff 2023-10-02 13:03:52,972 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-02 13:03:52,974 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,976 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-02 13:03:52,978 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-02 13:03:52,979 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,979 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-02 13:03:52,979 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251832979"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:52,990 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-02 13:03:52,990 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9312f993a08bf73230f500a698f7fcff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696251819163.9312f993a08bf73230f500a698f7fcff.', STARTKEY => '', ENDKEY => ''}] 2023-10-02 13:03:52,990 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-02 13:03:52,991 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696251832990"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:52,992 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-02 13:03:52,994 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:52,995 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 43 msec 2023-10-02 13:03:53,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-02 13:03:53,063 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-02 13:03:53,064 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 13:03:53,069 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251833069"}]},"ts":"1696251833069"} 2023-10-02 13:03:53,070 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-02 13:03:53,072 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-02 13:03:53,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a21a7ea8181e469dc2996d72e5a18c55, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=321c40603627c02e109164c26cdf2992, UNASSIGN}] 2023-10-02 13:03:53,074 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a21a7ea8181e469dc2996d72e5a18c55, UNASSIGN 2023-10-02 13:03:53,074 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=321c40603627c02e109164c26cdf2992, UNASSIGN 2023-10-02 13:03:53,075 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=a21a7ea8181e469dc2996d72e5a18c55, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:53,075 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=321c40603627c02e109164c26cdf2992, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:53,075 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696251833075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251833075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251833075"}]},"ts":"1696251833075"} 2023-10-02 13:03:53,075 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696251833075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251833075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251833075"}]},"ts":"1696251833075"} 2023-10-02 13:03:53,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure a21a7ea8181e469dc2996d72e5a18c55, server=jenkins-hbase4.apache.org,46465,1696251745531}] 2023-10-02 13:03:53,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 321c40603627c02e109164c26cdf2992, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:03:53,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 13:03:53,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 321c40603627c02e109164c26cdf2992 2023-10-02 13:03:53,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:53,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 321c40603627c02e109164c26cdf2992, disabling compactions & flushes 2023-10-02 13:03:53,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a21a7ea8181e469dc2996d72e5a18c55, disabling compactions & flushes 2023-10-02 13:03:53,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:53,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:53,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:53,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:53,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. after waiting 0 ms 2023-10-02 13:03:53,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. after waiting 0 ms 2023-10-02 13:03:53,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:53,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:53,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:03:53,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:03:53,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:03:53,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55. 2023-10-02 13:03:53,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a21a7ea8181e469dc2996d72e5a18c55: 2023-10-02 13:03:53,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:03:53,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992. 2023-10-02 13:03:53,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 321c40603627c02e109164c26cdf2992: 2023-10-02 13:03:53,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:53,245 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=a21a7ea8181e469dc2996d72e5a18c55, regionState=CLOSED 2023-10-02 13:03:53,245 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696251833245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251833245"}]},"ts":"1696251833245"} 2023-10-02 13:03:53,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 321c40603627c02e109164c26cdf2992 2023-10-02 13:03:53,245 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=321c40603627c02e109164c26cdf2992, regionState=CLOSED 2023-10-02 13:03:53,245 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696251833245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251833245"}]},"ts":"1696251833245"} 2023-10-02 13:03:53,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-02 13:03:53,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure a21a7ea8181e469dc2996d72e5a18c55, server=jenkins-hbase4.apache.org,46465,1696251745531 in 170 msec 2023-10-02 13:03:53,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-02 13:03:53,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 321c40603627c02e109164c26cdf2992, server=jenkins-hbase4.apache.org,33895,1696251745577 in 170 msec 2023-10-02 13:03:53,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a21a7ea8181e469dc2996d72e5a18c55, UNASSIGN in 176 msec 2023-10-02 13:03:53,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-02 13:03:53,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=321c40603627c02e109164c26cdf2992, UNASSIGN in 176 msec 2023-10-02 13:03:53,250 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251833250"}]},"ts":"1696251833250"} 2023-10-02 13:03:53,251 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-02 13:03:53,253 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-02 13:03:53,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 190 msec 2023-10-02 13:03:53,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 13:03:53,371 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-02 13:03:53,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,375 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,375 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,377 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,379 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,379 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,379 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,379 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,380 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 13:03:53,380 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 13:03:53,380 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 13:03:53,380 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 13:03:53,380 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992 2023-10-02 13:03:53,380 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:53,381 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,381 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,381 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:53,381 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,381 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,381 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:53,381 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:53,381 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:53,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-02 13:03:53,382 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/recovered.edits] 2023-10-02 13:03:53,382 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/recovered.edits] 2023-10-02 13:03:53,386 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/cf/963605afe1a6446c8f2b8ec57c77e0b4 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/cf/963605afe1a6446c8f2b8ec57c77e0b4 2023-10-02 13:03:53,386 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/cf/600b66411aee4aafba21abf118c221cd to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/cf/600b66411aee4aafba21abf118c221cd 2023-10-02 13:03:53,390 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992/recovered.edits/9.seqid 2023-10-02 13:03:53,390 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55/recovered.edits/9.seqid 2023-10-02 13:03:53,391 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/321c40603627c02e109164c26cdf2992 2023-10-02 13:03:53,391 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a21a7ea8181e469dc2996d72e5a18c55 2023-10-02 13:03:53,391 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-02 13:03:53,392 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-02 13:03:53,392 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-02 13:03:53,396 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100272125b2bc6944ab993da881bdab642ba to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100272125b2bc6944ab993da881bdab642ba 2023-10-02 13:03:53,397 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023100272746c4e8dc144f3928aab5ab561af08 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023100272746c4e8dc144f3928aab5ab561af08 2023-10-02 13:03:53,398 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-02 13:03:53,400 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,402 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-02 13:03:53,404 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-02 13:03:53,405 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,405 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-02 13:03:53,406 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251833405"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:53,406 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251833405"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:53,407 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 13:03:53,407 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a21a7ea8181e469dc2996d72e5a18c55, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696251817790.a21a7ea8181e469dc2996d72e5a18c55.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 321c40603627c02e109164c26cdf2992, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696251817790.321c40603627c02e109164c26cdf2992.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 13:03:53,408 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-02 13:03:53,408 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696251833408"}]},"ts":"9223372036854775807"} 2023-10-02 13:03:53,409 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-02 13:03:53,412 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 40 msec 2023-10-02 13:03:53,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-02 13:03:53,483 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-02 13:03:53,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-02 13:03:53,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-02 13:03:53,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 13:03:53,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-02 13:03:53,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 13:03:53,526 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 749) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:51594 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:60500 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4076 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:51566 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase4.apache.org/172.31.14.131:44807 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:51580 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1145319063_1 at /127.0.0.1:60468 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 233), ProcessCount=167 (was 167), AvailableMemoryMB=1275 (was 1350) 2023-10-02 13:03:53,527 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-02 13:03:53,546 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=167, AvailableMemoryMB=1274 2023-10-02 13:03:53,546 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-02 13:03:53,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 13:03:53,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 13:03:53,551 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 13:03:53,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-02 13:03:53,552 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 13:03:53,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 13:03:53,554 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:03:53,554 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:03:53,555 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9 empty. 2023-10-02 13:03:53,555 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8 empty. 2023-10-02 13:03:53,555 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:03:53,555 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:03:53,555 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-02 13:03:53,564 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-02 13:03:53,565 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 739e2bd009d53cc2fc3bf15609f325d9, NAME => 'testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:03:53,565 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9dfd9885bd021a3e74f3dd98cd0d13f8, NAME => 'testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 739e2bd009d53cc2fc3bf15609f325d9, disabling compactions & flushes 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9dfd9885bd021a3e74f3dd98cd0d13f8, disabling compactions & flushes 2023-10-02 13:03:53,573 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:53,573 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. after waiting 0 ms 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. after waiting 0 ms 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:53,573 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:53,573 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9dfd9885bd021a3e74f3dd98cd0d13f8: 2023-10-02 13:03:53,573 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 739e2bd009d53cc2fc3bf15609f325d9: 2023-10-02 13:03:53,575 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 13:03:53,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696251833576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251833576"}]},"ts":"1696251833576"} 2023-10-02 13:03:53,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696251833576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251833576"}]},"ts":"1696251833576"} 2023-10-02 13:03:53,578 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 13:03:53,579 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 13:03:53,579 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251833579"}]},"ts":"1696251833579"} 2023-10-02 13:03:53,581 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-02 13:03:53,584 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 13:03:53,585 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 13:03:53,585 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 13:03:53,585 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 13:03:53,585 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 13:03:53,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=739e2bd009d53cc2fc3bf15609f325d9, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9dfd9885bd021a3e74f3dd98cd0d13f8, ASSIGN}] 2023-10-02 13:03:53,588 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9dfd9885bd021a3e74f3dd98cd0d13f8, ASSIGN 2023-10-02 13:03:53,588 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=739e2bd009d53cc2fc3bf15609f325d9, ASSIGN 2023-10-02 13:03:53,589 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9dfd9885bd021a3e74f3dd98cd0d13f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46551,1696251745482; forceNewPlan=false, retain=false 2023-10-02 13:03:53,589 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=739e2bd009d53cc2fc3bf15609f325d9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33895,1696251745577; forceNewPlan=false, retain=false 2023-10-02 13:03:53,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 13:03:53,739 INFO [jenkins-hbase4:34719] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 13:03:53,742 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9dfd9885bd021a3e74f3dd98cd0d13f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:53,742 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=739e2bd009d53cc2fc3bf15609f325d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:53,742 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696251833742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251833742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251833742"}]},"ts":"1696251833742"} 2023-10-02 13:03:53,742 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696251833742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251833742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251833742"}]},"ts":"1696251833742"} 2023-10-02 13:03:53,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 9dfd9885bd021a3e74f3dd98cd0d13f8, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:03:53,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 739e2bd009d53cc2fc3bf15609f325d9, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:03:53,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 13:03:53,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:53,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 739e2bd009d53cc2fc3bf15609f325d9, NAME => 'testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 13:03:53,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. service=AccessControlService 2023-10-02 13:03:53,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:03:53,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9dfd9885bd021a3e74f3dd98cd0d13f8, NAME => 'testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 13:03:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:03:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. service=AccessControlService 2023-10-02 13:03:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:03:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:03:53,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:03:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:03:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:03:53,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:03:53,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:03:53,902 INFO [StoreOpener-739e2bd009d53cc2fc3bf15609f325d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:03:53,902 INFO [StoreOpener-9dfd9885bd021a3e74f3dd98cd0d13f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:03:53,903 DEBUG [StoreOpener-739e2bd009d53cc2fc3bf15609f325d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/cf 2023-10-02 13:03:53,903 DEBUG [StoreOpener-9dfd9885bd021a3e74f3dd98cd0d13f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/cf 2023-10-02 13:03:53,903 DEBUG [StoreOpener-9dfd9885bd021a3e74f3dd98cd0d13f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/cf 2023-10-02 13:03:53,903 DEBUG [StoreOpener-739e2bd009d53cc2fc3bf15609f325d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/cf 2023-10-02 13:03:53,904 INFO [StoreOpener-9dfd9885bd021a3e74f3dd98cd0d13f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dfd9885bd021a3e74f3dd98cd0d13f8 columnFamilyName cf 2023-10-02 13:03:53,904 INFO [StoreOpener-739e2bd009d53cc2fc3bf15609f325d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 739e2bd009d53cc2fc3bf15609f325d9 columnFamilyName cf 2023-10-02 13:03:53,905 INFO [StoreOpener-9dfd9885bd021a3e74f3dd98cd0d13f8-1] regionserver.HStore(310): Store=9dfd9885bd021a3e74f3dd98cd0d13f8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:03:53,905 INFO [StoreOpener-739e2bd009d53cc2fc3bf15609f325d9-1] regionserver.HStore(310): Store=739e2bd009d53cc2fc3bf15609f325d9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:03:53,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:03:53,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:03:53,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:03:53,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:03:53,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:03:53,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:03:53,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:03:53,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:03:53,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 739e2bd009d53cc2fc3bf15609f325d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61913178, jitterRate=-0.07742175459861755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:03:53,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9dfd9885bd021a3e74f3dd98cd0d13f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68127569, jitterRate=0.015179887413978577}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:03:53,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 739e2bd009d53cc2fc3bf15609f325d9: 2023-10-02 13:03:53,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9dfd9885bd021a3e74f3dd98cd0d13f8: 2023-10-02 13:03:53,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9., pid=94, masterSystemTime=1696251833896 2023-10-02 13:03:53,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8., pid=93, masterSystemTime=1696251833895 2023-10-02 13:03:53,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:53,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:53,915 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=739e2bd009d53cc2fc3bf15609f325d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:53,915 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696251833915"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251833915"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251833915"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251833915"}]},"ts":"1696251833915"} 2023-10-02 13:03:53,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:53,916 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9dfd9885bd021a3e74f3dd98cd0d13f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:53,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:53,916 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696251833916"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251833916"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251833916"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251833916"}]},"ts":"1696251833916"} 2023-10-02 13:03:53,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-02 13:03:53,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 739e2bd009d53cc2fc3bf15609f325d9, server=jenkins-hbase4.apache.org,33895,1696251745577 in 173 msec 2023-10-02 13:03:53,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-02 13:03:53,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 9dfd9885bd021a3e74f3dd98cd0d13f8, server=jenkins-hbase4.apache.org,46551,1696251745482 in 174 msec 2023-10-02 13:03:53,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=739e2bd009d53cc2fc3bf15609f325d9, ASSIGN in 334 msec 2023-10-02 13:03:53,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-02 13:03:53,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9dfd9885bd021a3e74f3dd98cd0d13f8, ASSIGN in 335 msec 2023-10-02 13:03:53,922 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 13:03:53,923 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251833923"}]},"ts":"1696251833923"} 2023-10-02 13:03:53,924 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-02 13:03:53,926 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 13:03:53,926 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-02 13:03:53,927 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 13:03:53,930 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:53,930 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:53,930 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:53,930 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:03:53,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:53,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:53,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:53,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 13:03:53,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 384 msec 2023-10-02 13:03:54,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 13:03:54,156 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-02 13:03:54,158 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-02 13:03:54,159 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:54,160 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:03:54,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:03:54,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251834171 (current time:1696251834171). 2023-10-02 13:03:54,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:03:54,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x70117792 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:54,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f4b6e92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:54,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:54,183 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:54,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70117792 to 127.0.0.1:55009 2023-10-02 13:03:54,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:54,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x03d8f1b2 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:54,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@780ebbbc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:54,191 DEBUG [hconnection-0x3c7575d1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:54,194 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:54,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:54,200 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:54,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03d8f1b2 to 127.0.0.1:55009 2023-10-02 13:03:54,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:54,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 13:03:54,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:03:54,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:03:54,205 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:03:54,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:03:54,210 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:03:54,211 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696252434211 2023-10-02 13:03:54,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:03:54,211 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-02 13:03:54,212 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:03:54,212 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:03:54,213 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:03:54,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 13:03:54,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-02 13:03:54,217 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 13:03:54,217 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696252434217 2023-10-02 13:03:54,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,225 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-02 13:03:54,225 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:54,227 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-02 13:03:54,227 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-02 13:03:54,227 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,227 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,233 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,233 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,233 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,233 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,233 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,234 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,234 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,234 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:03:54,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 13:03:54,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 13:03:54,235 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 13:03:54,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,235 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 13:03:54,235 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,235 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 13:03:54,235 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:54,237 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 13:03:54,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,237 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 13:03:54,237 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 13:03:54,237 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:54,237 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 13:03:54,238 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 13:03:54,238 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 13:03:54,238 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 13:03:54,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 13:03:54,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,239 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 13:03:54,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,239 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 13:03:54,239 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:54,240 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 13:03:54,240 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 13:03:54,240 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 13:03:54,241 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,241 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:54,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:54,242 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,242 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,242 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:54,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:54,242 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,242 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:54,243 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,243 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:54,243 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,243 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:54,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:54,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 13:03:54,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12096131[Count = 1] remaining members to acquire global barrier 2023-10-02 13:03:54,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:54,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:54,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:54,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:54,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:54,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 13:03:54,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12096131[Count = 0] remaining members to acquire global barrier 2023-10-02 13:03:54,247 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 13:03:54,248 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,249 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,249 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,249 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,249 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:03:54,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,249 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:03:54,249 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:54,249 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,249 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:54,249 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:54,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,249 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:54,250 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:03:54,250 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 13:03:54,249 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:54,249 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:54,250 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. started... 2023-10-02 13:03:54,250 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,250 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:03:54,250 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:03:54,250 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. started... 2023-10-02 13:03:54,251 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9dfd9885bd021a3e74f3dd98cd0d13f8: 2023-10-02 13:03:54,251 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 739e2bd009d53cc2fc3bf15609f325d9: 2023-10-02 13:03:54,251 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,252 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,252 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:54,252 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:54,252 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:03:54,252 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:03:54,253 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 13:03:54,253 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:54,254 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 13:03:54,265 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. completed. 2023-10-02 13:03:54,265 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:54,265 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:54,265 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:54,265 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,265 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 13:03:54,265 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:03:54,267 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 13:03:54,267 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:54,267 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,267 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 13:03:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:54,268 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. completed. 2023-10-02 13:03:54,269 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:54,269 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:54,269 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:54,269 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,269 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 13:03:54,269 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:03:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:54,270 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,270 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 13:03:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,270 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:54,270 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 13:03:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46551,1696251745482': 2023-10-02 13:03:54,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 13:03:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:54,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33895,1696251745577': 2023-10-02 13:03:54,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 13:03:54,277 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-02 13:03:54,277 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:03:54,277 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:03:54,277 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,277 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:03:54,279 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,279 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,279 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,279 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,279 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,279 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:54,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:54,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,280 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,279 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:54,280 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,281 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,282 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:54,282 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,283 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,287 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,287 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,288 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,288 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,288 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,288 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,288 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,288 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,288 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,288 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:54,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-02 13:03:54,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,288 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,288 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,290 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:03:54,290 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,290 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,290 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,290 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,290 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 13:03:54,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,312 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:54,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 13:03:54,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:03:54,313 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:03:54,313 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-02 13:03:54,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,314 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696251834211Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696251834297 (+86 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696251834297Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696251834297Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696251834301 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696251834308 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696251834313 (+5 ms) 2023-10-02 13:03:54,317 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 13:03:54,318 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 105 msec 2023-10-02 13:03:54,513 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:54,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 13:03:54,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:03:54,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33895] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:03:54,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46551] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:03:54,521 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-02 13:03:54,521 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:54,521 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:03:54,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:03:54,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251834530 (current time:1696251834530). 2023-10-02 13:03:54,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:03:54,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x726d5d08 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:54,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9966760, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:54,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:54,541 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:54,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x726d5d08 to 127.0.0.1:55009 2023-10-02 13:03:54,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:54,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x7f4e2d07 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:03:54,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6753bafb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:03:54,548 DEBUG [hconnection-0x5dc46c16-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:54,549 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:54,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:03:54,554 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:03:54,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f4e2d07 to 127.0.0.1:55009 2023-10-02 13:03:54,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:03:54,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 13:03:54,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:03:54,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:03:54,558 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:03:54,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:03:54,560 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:03:54,560 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696252434560 2023-10-02 13:03:54,560 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-02 13:03:54,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 13:03:54,562 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:03:54,562 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:03:54,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 13:03:54,562 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 13:03:54,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-02 13:03:54,564 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 13:03:54,565 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696252434565 2023-10-02 13:03:54,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,573 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-02 13:03:54,573 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:54,574 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-02 13:03:54,574 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-02 13:03:54,575 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,575 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,576 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,576 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,576 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,576 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,577 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,577 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,577 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,577 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 13:03:54,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 13:03:54,578 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 13:03:54,578 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:54,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 13:03:54,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 13:03:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 13:03:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 13:03:54,580 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 13:03:54,580 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 13:03:54,580 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 13:03:54,580 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 13:03:54,579 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:03:54,583 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 13:03:54,583 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 13:03:54,583 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 13:03:54,585 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:54,585 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,586 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:54,586 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:54,586 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,586 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:54,586 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:03:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:54,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 13:03:54,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bc7e438[Count = 1] remaining members to acquire global barrier 2023-10-02 13:03:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:54,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:54,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:54,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:54,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 13:03:54,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bc7e438[Count = 0] remaining members to acquire global barrier 2023-10-02 13:03:54,589 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 13:03:54,589 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,595 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,595 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,595 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,595 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:03:54,595 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:03:54,595 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,595 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:54,595 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,595 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:03:54,595 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:54,595 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:54,595 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. started... 2023-10-02 13:03:54,595 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. started... 2023-10-02 13:03:54,595 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,595 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:03:54,595 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:03:54,595 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 739e2bd009d53cc2fc3bf15609f325d9 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-02 13:03:54,596 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9dfd9885bd021a3e74f3dd98cd0d13f8 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-02 13:03:54,595 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 13:03:54,596 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 13:03:54,596 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:03:54,597 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 13:03:54,597 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:54,597 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 13:03:54,613 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100293d4d70477984b998a25bb048689edf4 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100293d4d70477984b998a25bb048689edf4 2023-10-02 13:03:54,613 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002cad9e5a6acd144f682ed015ed236af96 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002cad9e5a6acd144f682ed015ed236af96 2023-10-02 13:03:54,623 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/.tmp/cf/8a23e6aeb70146fb872940e664b5e8a2 2023-10-02 13:03:54,623 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/.tmp/cf/b9a2f3fecad345a1a6c974da4b362e9b 2023-10-02 13:03:54,629 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/.tmp/cf/b9a2f3fecad345a1a6c974da4b362e9b as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/cf/b9a2f3fecad345a1a6c974da4b362e9b 2023-10-02 13:03:54,629 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/.tmp/cf/8a23e6aeb70146fb872940e664b5e8a2 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/cf/8a23e6aeb70146fb872940e664b5e8a2 2023-10-02 13:03:54,634 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/cf/8a23e6aeb70146fb872940e664b5e8a2, entries=5, sequenceid=6, filesize=5.8 K 2023-10-02 13:03:54,634 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/cf/b9a2f3fecad345a1a6c974da4b362e9b, entries=45, sequenceid=6, filesize=12.7 K 2023-10-02 13:03:54,634 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 9dfd9885bd021a3e74f3dd98cd0d13f8 in 39ms, sequenceid=6, compaction requested=false 2023-10-02 13:03:54,634 INFO [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 739e2bd009d53cc2fc3bf15609f325d9 in 39ms, sequenceid=6, compaction requested=false 2023-10-02 13:03:54,635 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-02 13:03:54,635 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-02 13:03:54,638 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9dfd9885bd021a3e74f3dd98cd0d13f8: 2023-10-02 13:03:54,638 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 739e2bd009d53cc2fc3bf15609f325d9: 2023-10-02 13:03:54,638 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,638 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,638 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:54,639 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:03:54,639 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/cf/b9a2f3fecad345a1a6c974da4b362e9b] hfiles 2023-10-02 13:03:54,639 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/cf/8a23e6aeb70146fb872940e664b5e8a2] hfiles 2023-10-02 13:03:54,639 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/cf/b9a2f3fecad345a1a6c974da4b362e9b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,639 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/cf/8a23e6aeb70146fb872940e664b5e8a2 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,647 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. completed. 2023-10-02 13:03:54,647 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:03:54,647 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:54,647 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:54,647 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,647 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 13:03:54,647 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:03:54,649 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. completed. 2023-10-02 13:03:54,649 DEBUG [rs(jenkins-hbase4.apache.org,33895,1696251745577)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:03:54,649 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:03:54,649 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 13:03:54,649 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,649 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:54,649 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:03:54,649 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,649 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 13:03:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:54,650 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 13:03:54,650 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:03:54,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:54,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:54,652 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,652 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 13:03:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,652 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:54,652 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 13:03:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46551,1696251745482': 2023-10-02 13:03:54,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 13:03:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33895,1696251745577': 2023-10-02 13:03:54,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 13:03:54,659 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-02 13:03:54,659 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:03:54,659 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:03:54,659 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,659 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:03:54,661 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,661 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,661 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,661 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,661 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,661 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,661 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,662 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,662 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:03:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:03:54,662 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:03:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,663 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 13:03:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:03:54,663 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:03:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:03:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,664 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,665 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,665 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:03:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,667 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,667 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,667 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,667 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,668 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,667 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,668 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:03:54,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,667 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:03:54,667 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,669 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:03:54,669 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:03:54,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,669 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-02 13:03:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:03:54,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,669 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:03:54,670 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:03:54,670 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,670 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:03:54,670 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:03:54,670 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,670 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002cad9e5a6acd144f682ed015ed236af96, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100293d4d70477984b998a25bb048689edf4] mob files 2023-10-02 13:03:54,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002cad9e5a6acd144f682ed015ed236af96 2023-10-02 13:03:54,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100293d4d70477984b998a25bb048689edf4 2023-10-02 13:03:54,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:03:54,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:03:54,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-02 13:03:54,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,709 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696251834560Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696251834678 (+118 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696251834678Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696251834678Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696251834682 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696251834701 (+19 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696251834709 (+8 ms) 2023-10-02 13:03:54,714 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 13:03:54,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 154 msec 2023-10-02 13:03:54,864 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:03:54,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 13:03:54,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:03:54,865 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251834865 2023-10-02 13:03:54,865 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35861, tgtDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251834865, rawTgtDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251834865, srcFsUri=hdfs://localhost:35861, srcDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:03:54,887 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:03:54,887 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_876002408_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251834865, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251834865/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,887 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c, snapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-02 13:03:54,893 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251834865/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:03:54,912 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:54,912 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:54,913 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:54,913 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:55,803 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-9097189001141001481.jar 2023-10-02 13:03:55,804 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:55,804 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:55,871 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-5772643510445602672.jar 2023-10-02 13:03:55,872 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:55,872 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:55,873 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:55,873 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:55,873 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:55,874 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 13:03:55,874 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 13:03:55,874 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 13:03:55,875 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 13:03:55,875 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 13:03:55,875 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 13:03:55,876 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 13:03:55,876 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 13:03:55,876 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 13:03:55,877 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 13:03:55,877 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 13:03:55,878 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:55,878 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:55,879 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:55,879 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:55,879 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:03:55,880 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:55,880 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:03:56,239 WARN [Listener at jenkins-hbase4.apache.org/39417] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 13:03:56,241 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-02 13:03:57,171 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:03:57,171 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:03:57,174 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0005_000001 (auth:SIMPLE) 2023-10-02 13:03:57,669 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0006_000001 (auth:SIMPLE) 2023-10-02 13:03:58,410 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 13:04:01,447 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0006_000001 (auth:SIMPLE) 2023-10-02 13:04:04,595 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 13:04:04,596 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 13:04:04,601 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:04:04,601 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 13:04:04,602 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 13:04:04,602 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:04:04,602 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-02 13:04:04,602 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-02 13:04:04,602 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251834865/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251834865/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:04:04,603 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251834865/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-02 13:04:04,603 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251834865/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-02 13:04:04,609 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 13:04:04,613 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251844613"}]},"ts":"1696251844613"} 2023-10-02 13:04:04,614 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-02 13:04:04,616 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-02 13:04:04,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=739e2bd009d53cc2fc3bf15609f325d9, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9dfd9885bd021a3e74f3dd98cd0d13f8, UNASSIGN}] 2023-10-02 13:04:04,618 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=739e2bd009d53cc2fc3bf15609f325d9, UNASSIGN 2023-10-02 13:04:04,618 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9dfd9885bd021a3e74f3dd98cd0d13f8, UNASSIGN 2023-10-02 13:04:04,619 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=739e2bd009d53cc2fc3bf15609f325d9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:04,619 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9dfd9885bd021a3e74f3dd98cd0d13f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:04,619 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696251844619"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251844619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251844619"}]},"ts":"1696251844619"} 2023-10-02 13:04:04,619 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696251844619"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251844619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251844619"}]},"ts":"1696251844619"} 2023-10-02 13:04:04,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 739e2bd009d53cc2fc3bf15609f325d9, server=jenkins-hbase4.apache.org,33895,1696251745577}] 2023-10-02 13:04:04,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 9dfd9885bd021a3e74f3dd98cd0d13f8, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:04:04,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 13:04:04,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:04:04,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:04:04,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9dfd9885bd021a3e74f3dd98cd0d13f8, disabling compactions & flushes 2023-10-02 13:04:04,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 739e2bd009d53cc2fc3bf15609f325d9, disabling compactions & flushes 2023-10-02 13:04:04,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:04:04,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:04:04,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:04:04,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:04:04,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. after waiting 0 ms 2023-10-02 13:04:04,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:04:04,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. after waiting 0 ms 2023-10-02 13:04:04,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:04:04,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:04:04,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:04:04,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:04,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:04,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9. 2023-10-02 13:04:04,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 739e2bd009d53cc2fc3bf15609f325d9: 2023-10-02 13:04:04,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8. 2023-10-02 13:04:04,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9dfd9885bd021a3e74f3dd98cd0d13f8: 2023-10-02 13:04:04,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:04:04,784 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9dfd9885bd021a3e74f3dd98cd0d13f8, regionState=CLOSED 2023-10-02 13:04:04,784 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696251844784"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251844784"}]},"ts":"1696251844784"} 2023-10-02 13:04:04,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:04:04,785 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=739e2bd009d53cc2fc3bf15609f325d9, regionState=CLOSED 2023-10-02 13:04:04,785 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696251844785"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251844785"}]},"ts":"1696251844785"} 2023-10-02 13:04:04,787 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-02 13:04:04,787 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 9dfd9885bd021a3e74f3dd98cd0d13f8, server=jenkins-hbase4.apache.org,46551,1696251745482 in 165 msec 2023-10-02 13:04:04,788 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-02 13:04:04,788 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 739e2bd009d53cc2fc3bf15609f325d9, server=jenkins-hbase4.apache.org,33895,1696251745577 in 166 msec 2023-10-02 13:04:04,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9dfd9885bd021a3e74f3dd98cd0d13f8, UNASSIGN in 171 msec 2023-10-02 13:04:04,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-10-02 13:04:04,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=739e2bd009d53cc2fc3bf15609f325d9, UNASSIGN in 172 msec 2023-10-02 13:04:04,790 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251844790"}]},"ts":"1696251844790"} 2023-10-02 13:04:04,791 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-02 13:04:04,792 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-02 13:04:04,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 184 msec 2023-10-02 13:04:04,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 13:04:04,915 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-02 13:04:04,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,919 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,920 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,921 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,924 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:04:04,924 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:04:04,924 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,924 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,924 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,924 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,925 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 13:04:04,925 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 13:04:04,925 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 13:04:04,925 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 13:04:04,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:04,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:04,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:04,926 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:04,926 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/recovered.edits] 2023-10-02 13:04:04,926 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/recovered.edits] 2023-10-02 13:04:04,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-02 13:04:04,930 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/cf/8a23e6aeb70146fb872940e664b5e8a2 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/cf/8a23e6aeb70146fb872940e664b5e8a2 2023-10-02 13:04:04,930 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/cf/b9a2f3fecad345a1a6c974da4b362e9b to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/cf/b9a2f3fecad345a1a6c974da4b362e9b 2023-10-02 13:04:04,932 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9/recovered.edits/9.seqid 2023-10-02 13:04:04,932 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8/recovered.edits/9.seqid 2023-10-02 13:04:04,933 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/739e2bd009d53cc2fc3bf15609f325d9 2023-10-02 13:04:04,933 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testEmptyExportFileSystemState/9dfd9885bd021a3e74f3dd98cd0d13f8 2023-10-02 13:04:04,933 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-02 13:04:04,933 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-02 13:04:04,934 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-02 13:04:04,937 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002cad9e5a6acd144f682ed015ed236af96 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002cad9e5a6acd144f682ed015ed236af96 2023-10-02 13:04:04,938 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100293d4d70477984b998a25bb048689edf4 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100293d4d70477984b998a25bb048689edf4 2023-10-02 13:04:04,938 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-02 13:04:04,941 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,943 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-02 13:04:04,944 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-02 13:04:04,945 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,945 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-02 13:04:04,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251844945"}]},"ts":"9223372036854775807"} 2023-10-02 13:04:04,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251844945"}]},"ts":"9223372036854775807"} 2023-10-02 13:04:04,948 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 13:04:04,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 739e2bd009d53cc2fc3bf15609f325d9, NAME => 'testtb-testEmptyExportFileSystemState,,1696251833548.739e2bd009d53cc2fc3bf15609f325d9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9dfd9885bd021a3e74f3dd98cd0d13f8, NAME => 'testtb-testEmptyExportFileSystemState,1,1696251833548.9dfd9885bd021a3e74f3dd98cd0d13f8.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 13:04:04,948 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-02 13:04:04,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696251844948"}]},"ts":"9223372036854775807"} 2023-10-02 13:04:04,953 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-02 13:04:04,955 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 13:04:04,956 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-10-02 13:04:05,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-02 13:04:05,028 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-02 13:04:05,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-02 13:04:05,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 13:04:05,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-02 13:04:05,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-02 13:04:05,064 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=767 (was 761) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1242492599_1 at /127.0.0.1:34042 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:35972 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:43816 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase4.apache.org/172.31.14.131:35609 from appattempt_1696251752115_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1242492599_1 at /127.0.0.1:43804 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase4.apache.org/172.31.14.131:44111 from appattempt_1696251752115_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563281491_17 at /127.0.0.1:34110 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (161938400) connection to jenkins-hbase4.apache.org/172.31.14.131:36277 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4729 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3e7fc64a-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 917) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=193 (was 213), ProcessCount=167 (was 167), AvailableMemoryMB=1286 (was 1274) - AvailableMemoryMB LEAK? - 2023-10-02 13:04:05,064 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-02 13:04:05,083 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=193, ProcessCount=167, AvailableMemoryMB=1285 2023-10-02 13:04:05,083 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-02 13:04:05,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 13:04:05,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,088 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 13:04:05,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-02 13:04:05,089 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 13:04:05,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 13:04:05,091 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:05,091 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:05,091 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333 empty. 2023-10-02 13:04:05,091 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c empty. 2023-10-02 13:04:05,092 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:05,092 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:05,092 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-02 13:04:05,101 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-02 13:04:05,102 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 99c5e3453fe69f7d8c97baa61633a333, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:04:05,103 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4ca6b342eaf041af2fa804f131f4dd3c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp 2023-10-02 13:04:05,110 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:04:05,110 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 4ca6b342eaf041af2fa804f131f4dd3c, disabling compactions & flushes 2023-10-02 13:04:05,110 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:05,110 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:05,110 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. after waiting 0 ms 2023-10-02 13:04:05,110 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:05,110 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:05,110 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 4ca6b342eaf041af2fa804f131f4dd3c: 2023-10-02 13:04:05,117 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:04:05,117 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 99c5e3453fe69f7d8c97baa61633a333, disabling compactions & flushes 2023-10-02 13:04:05,117 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:05,117 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:05,117 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. after waiting 0 ms 2023-10-02 13:04:05,117 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:05,117 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:05,117 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 99c5e3453fe69f7d8c97baa61633a333: 2023-10-02 13:04:05,119 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 13:04:05,120 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696251845120"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251845120"}]},"ts":"1696251845120"} 2023-10-02 13:04:05,120 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696251845120"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251845120"}]},"ts":"1696251845120"} 2023-10-02 13:04:05,122 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 13:04:05,123 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 13:04:05,123 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251845123"}]},"ts":"1696251845123"} 2023-10-02 13:04:05,124 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-02 13:04:05,129 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 13:04:05,130 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 13:04:05,130 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 13:04:05,130 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 13:04:05,130 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 13:04:05,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=99c5e3453fe69f7d8c97baa61633a333, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ca6b342eaf041af2fa804f131f4dd3c, ASSIGN}] 2023-10-02 13:04:05,132 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ca6b342eaf041af2fa804f131f4dd3c, ASSIGN 2023-10-02 13:04:05,133 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=99c5e3453fe69f7d8c97baa61633a333, ASSIGN 2023-10-02 13:04:05,133 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ca6b342eaf041af2fa804f131f4dd3c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46465,1696251745531; forceNewPlan=false, retain=false 2023-10-02 13:04:05,133 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=99c5e3453fe69f7d8c97baa61633a333, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46551,1696251745482; forceNewPlan=false, retain=false 2023-10-02 13:04:05,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 13:04:05,283 INFO [jenkins-hbase4:34719] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 13:04:05,286 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4ca6b342eaf041af2fa804f131f4dd3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=99c5e3453fe69f7d8c97baa61633a333, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,286 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696251845286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251845286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251845286"}]},"ts":"1696251845286"} 2023-10-02 13:04:05,286 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696251845286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251845286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251845286"}]},"ts":"1696251845286"} 2023-10-02 13:04:05,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 99c5e3453fe69f7d8c97baa61633a333, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:04:05,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 4ca6b342eaf041af2fa804f131f4dd3c, server=jenkins-hbase4.apache.org,46465,1696251745531}] 2023-10-02 13:04:05,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 13:04:05,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:05,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:05,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 99c5e3453fe69f7d8c97baa61633a333, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 13:04:05,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4ca6b342eaf041af2fa804f131f4dd3c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 13:04:05,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. service=AccessControlService 2023-10-02 13:04:05,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. service=AccessControlService 2023-10-02 13:04:05,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:04:05,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 13:04:05,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:05,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:05,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:04:05,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 13:04:05,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:05,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:05,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:05,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:05,445 INFO [StoreOpener-99c5e3453fe69f7d8c97baa61633a333-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:05,445 INFO [StoreOpener-4ca6b342eaf041af2fa804f131f4dd3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:05,446 DEBUG [StoreOpener-99c5e3453fe69f7d8c97baa61633a333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/cf 2023-10-02 13:04:05,446 DEBUG [StoreOpener-4ca6b342eaf041af2fa804f131f4dd3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/cf 2023-10-02 13:04:05,446 DEBUG [StoreOpener-4ca6b342eaf041af2fa804f131f4dd3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/cf 2023-10-02 13:04:05,446 DEBUG [StoreOpener-99c5e3453fe69f7d8c97baa61633a333-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/cf 2023-10-02 13:04:05,446 INFO [StoreOpener-4ca6b342eaf041af2fa804f131f4dd3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ca6b342eaf041af2fa804f131f4dd3c columnFamilyName cf 2023-10-02 13:04:05,446 INFO [StoreOpener-99c5e3453fe69f7d8c97baa61633a333-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99c5e3453fe69f7d8c97baa61633a333 columnFamilyName cf 2023-10-02 13:04:05,448 INFO [StoreOpener-99c5e3453fe69f7d8c97baa61633a333-1] regionserver.HStore(310): Store=99c5e3453fe69f7d8c97baa61633a333/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:04:05,448 INFO [StoreOpener-4ca6b342eaf041af2fa804f131f4dd3c-1] regionserver.HStore(310): Store=4ca6b342eaf041af2fa804f131f4dd3c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 13:04:05,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:05,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:05,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:05,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:05,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:05,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:05,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:04:05,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 13:04:05,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 99c5e3453fe69f7d8c97baa61633a333; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74298722, jitterRate=0.10713723301887512}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:04:05,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 99c5e3453fe69f7d8c97baa61633a333: 2023-10-02 13:04:05,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4ca6b342eaf041af2fa804f131f4dd3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61358251, jitterRate=-0.08569081127643585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 13:04:05,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4ca6b342eaf041af2fa804f131f4dd3c: 2023-10-02 13:04:05,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333., pid=108, masterSystemTime=1696251845440 2023-10-02 13:04:05,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c., pid=109, masterSystemTime=1696251845440 2023-10-02 13:04:05,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:05,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:05,456 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=99c5e3453fe69f7d8c97baa61633a333, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:05,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:05,457 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696251845456"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251845456"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251845456"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251845456"}]},"ts":"1696251845456"} 2023-10-02 13:04:05,457 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4ca6b342eaf041af2fa804f131f4dd3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,457 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696251845457"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696251845457"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696251845457"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696251845457"}]},"ts":"1696251845457"} 2023-10-02 13:04:05,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-02 13:04:05,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 99c5e3453fe69f7d8c97baa61633a333, server=jenkins-hbase4.apache.org,46551,1696251745482 in 170 msec 2023-10-02 13:04:05,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-02 13:04:05,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 4ca6b342eaf041af2fa804f131f4dd3c, server=jenkins-hbase4.apache.org,46465,1696251745531 in 169 msec 2023-10-02 13:04:05,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=99c5e3453fe69f7d8c97baa61633a333, ASSIGN in 329 msec 2023-10-02 13:04:05,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-02 13:04:05,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ca6b342eaf041af2fa804f131f4dd3c, ASSIGN in 330 msec 2023-10-02 13:04:05,462 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 13:04:05,463 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251845462"}]},"ts":"1696251845462"} 2023-10-02 13:04:05,464 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-02 13:04:05,466 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 13:04:05,466 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-02 13:04:05,467 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 13:04:05,469 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:05,469 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:05,469 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:05,469 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:05,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 13:04:05,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 13:04:05,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 13:04:05,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 13:04:05,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 386 msec 2023-10-02 13:04:05,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 13:04:05,693 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-02 13:04:05,695 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,695 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:05,697 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:04:05,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 13:04:05,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251845707 (current time:1696251845707). 2023-10-02 13:04:05,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:04:05,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x3dcc7cf4 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:04:05,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e95d07e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:04:05,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:04:05,718 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:04:05,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3dcc7cf4 to 127.0.0.1:55009 2023-10-02 13:04:05,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:05,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x531d2a34 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:04:05,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@de8c77f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:04:05,726 DEBUG [hconnection-0x6d1ef09c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:04:05,728 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:04:05,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:04:05,734 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:04:05,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x531d2a34 to 127.0.0.1:55009 2023-10-02 13:04:05,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:05,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 13:04:05,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:04:05,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 13:04:05,739 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:04:05,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 13:04:05,741 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 13:04:05,742 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696252445742 2023-10-02 13:04:05,742 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 13:04:05,743 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:04:05,743 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:04:05,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 13:04:05,744 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 13:04:05,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-02 13:04:05,746 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 13:04:05,746 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696252445746 2023-10-02 13:04:05,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,762 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-02 13:04:05,762 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:04:05,763 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-02 13:04:05,763 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-02 13:04:05,764 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,764 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,766 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:05,766 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:05,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:05,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:05,766 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,766 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:05,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,767 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,767 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,767 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,767 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:04:05,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 13:04:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 13:04:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 13:04:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 13:04:05,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 13:04:05,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 13:04:05,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,768 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 13:04:05,768 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 13:04:05,768 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:04:05,768 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:04:05,770 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 13:04:05,770 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 13:04:05,770 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 13:04:05,770 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 13:04:05,770 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 13:04:05,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,770 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 13:04:05,770 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 13:04:05,770 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:04:05,771 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 13:04:05,771 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 13:04:05,771 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 13:04:05,779 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,779 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:04:05,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:04:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:04:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:04:05,780 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:04:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,780 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:04:05,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:04:05,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:04:05,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 13:04:05,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2df955[Count = 1] remaining members to acquire global barrier 2023-10-02 13:04:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:04:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:04:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:04:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:04:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:04:05,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 13:04:05,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2df955[Count = 0] remaining members to acquire global barrier 2023-10-02 13:04:05,783 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-02 13:04:05,784 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,785 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,785 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,785 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 13:04:05,785 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,785 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,785 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 13:04:05,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,785 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 13:04:05,785 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 13:04:05,786 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:04:05,786 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,786 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:04:05,787 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 13:04:05,787 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:04:05,787 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 13:04:05,790 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:04:05,790 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:04:05,790 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:04:05,790 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:04:05,790 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:05,790 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:05,790 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. started... 2023-10-02 13:04:05,790 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. started... 2023-10-02 13:04:05,791 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ca6b342eaf041af2fa804f131f4dd3c: 2023-10-02 13:04:05,791 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 99c5e3453fe69f7d8c97baa61633a333: 2023-10-02 13:04:05,791 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,791 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:04:05,791 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:04:05,791 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,792 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:04:05,792 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 13:04:05,807 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. completed. 2023-10-02 13:04:05,807 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. completed. 2023-10-02 13:04:05,807 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:05,807 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:05,807 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:04:05,807 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:04:05,807 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,807 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:04:05,807 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:04:05,807 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,807 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 13:04:05,808 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 13:04:05,808 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:04:05,808 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:04:05,810 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 13:04:05,810 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:04:05,810 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 13:04:05,812 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 13:04:05,812 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,812 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:04:05,812 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,812 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 13:04:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:04:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:04:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:04:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:04:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:04:05,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46551,1696251745482': 2023-10-02 13:04:05,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-02 13:04:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:04:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:04:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:04:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:04:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:04:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46465,1696251745531': 2023-10-02 13:04:05,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-02 13:04:05,827 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-02 13:04:05,827 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:04:05,827 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:04:05,827 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,827 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:04:05,828 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,828 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,828 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:04:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:04:05,828 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,828 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:05,828 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:05,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:05,829 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:05,829 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:04:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,829 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:05,830 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:04:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,831 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:04:05,831 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,832 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,834 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,834 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,834 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:05,834 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:05,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:05,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:05,834 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:05,834 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:04:05,834 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:05,834 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,836 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:05,836 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:05,836 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:05,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:05,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,834 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:05,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:05,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:05,836 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,836 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:05,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:05,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,836 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:04:05,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:05,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:05,837 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:05,837 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:05,837 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,837 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 13:04:05,843 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:04:05,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 13:04:05,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:04:05,844 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:04:05,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-02 13:04:05,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,883 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:05,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696251845742Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696251845847 (+105 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696251845847Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696251845847Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696251845852 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696251845875 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696251845882 (+7 ms) 2023-10-02 13:04:05,886 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 13:04:05,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 143 msec 2023-10-02 13:04:06,045 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:04:06,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 13:04:06,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:04:06,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46551] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:04:06,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46465] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 13:04:06,052 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,052 DEBUG [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:06,052 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 13:04:06,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 13:04:06,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696251846061 (current time:1696251846061). 2023-10-02 13:04:06,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 13:04:06,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x00721ec3 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:04:06,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f342fdb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:04:06,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:04:06,069 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:04:06,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00721ec3 to 127.0.0.1:55009 2023-10-02 13:04:06,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:06,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(139): Connect 0x31c70bc4 to 127.0.0.1:55009 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 13:04:06,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21539f39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 13:04:06,078 DEBUG [hconnection-0x2f17363f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:04:06,080 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:04:06,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 13:04:06,091 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 13:04:06,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31c70bc4 to 127.0.0.1:55009 2023-10-02 13:04:06,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:06,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 13:04:06,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 13:04:06,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 13:04:06,097 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot, current working dir path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 13:04:06,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 13:04:06,099 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 13:04:06,100 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696252446100 2023-10-02 13:04:06,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 13:04:06,100 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,102 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 13:04:06,102 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 13:04:06,102 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 13:04:06,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 13:04:06,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-02 13:04:06,104 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 13:04:06,105 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696252446105 2023-10-02 13:04:06,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,113 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-02 13:04:06,113 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:04:06,115 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-02 13:04:06,115 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-02 13:04:06,115 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,115 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,117 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:06,117 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:06,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:06,117 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:06,117 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:06,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:06,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:06,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:06,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:06,117 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,117 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,118 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,118 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 13:04:06,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,118 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 13:04:06,120 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,120 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,120 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 13:04:06,120 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 13:04:06,121 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:04:06,120 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:04:06,120 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,123 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 13:04:06,123 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 13:04:06,122 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 13:04:06,123 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 13:04:06,123 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 13:04:06,123 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 13:04:06,124 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 13:04:06,124 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 13:04:06,124 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 13:04:06,123 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33895,1696251745577' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 13:04:06,124 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 13:04:06,127 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,127 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:04:06,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:04:06,127 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,127 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,127 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,127 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:04:06,127 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:04:06,127 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,127 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:04:06,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:04:06,128 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,128 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 13:04:06,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:04:06,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46465,1696251745531' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 13:04:06,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d5f998f[Count = 1] remaining members to acquire global barrier 2023-10-02 13:04:06,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:04:06,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:04:06,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:04:06,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:04:06,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:04:06,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46551,1696251745482' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 13:04:06,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d5f998f[Count = 0] remaining members to acquire global barrier 2023-10-02 13:04:06,131 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-02 13:04:06,131 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,134 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,134 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,134 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,134 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 13:04:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,134 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,134 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 13:04:06,134 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 13:04:06,135 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:04:06,135 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:04:06,135 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:06,135 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 13:04:06,135 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 13:04:06,135 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:06,135 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,135 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. started... 2023-10-02 13:04:06,135 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 13:04:06,135 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 13:04:06,135 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. started... 2023-10-02 13:04:06,135 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33895,1696251745577' in zk 2023-10-02 13:04:06,135 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4ca6b342eaf041af2fa804f131f4dd3c 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-02 13:04:06,135 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 99c5e3453fe69f7d8c97baa61633a333 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-02 13:04:06,137 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 13:04:06,137 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:04:06,137 DEBUG [member: 'jenkins-hbase4.apache.org,33895,1696251745577' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 13:04:06,154 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231002c8414474b8244765b0da4dece5122f4a to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002c8414474b8244765b0da4dece5122f4a 2023-10-02 13:04:06,154 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100289d6b8f88b854bfab6399268dccd0b81 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100289d6b8f88b854bfab6399268dccd0b81 2023-10-02 13:04:06,161 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/.tmp/cf/01e3e5ffcb6f483cb4b032e7a62ac583 2023-10-02 13:04:06,161 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/.tmp/cf/7fb222d761b84ea1ac7caed298a0e03b 2023-10-02 13:04:06,165 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/.tmp/cf/7fb222d761b84ea1ac7caed298a0e03b as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/cf/7fb222d761b84ea1ac7caed298a0e03b 2023-10-02 13:04:06,165 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/.tmp/cf/01e3e5ffcb6f483cb4b032e7a62ac583 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/cf/01e3e5ffcb6f483cb4b032e7a62ac583 2023-10-02 13:04:06,170 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/cf/7fb222d761b84ea1ac7caed298a0e03b, entries=48, sequenceid=6, filesize=13.5 K 2023-10-02 13:04:06,170 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/cf/01e3e5ffcb6f483cb4b032e7a62ac583, entries=2, sequenceid=6, filesize=5.2 K 2023-10-02 13:04:06,171 INFO [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 99c5e3453fe69f7d8c97baa61633a333 in 36ms, sequenceid=6, compaction requested=false 2023-10-02 13:04:06,171 INFO [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 4ca6b342eaf041af2fa804f131f4dd3c in 36ms, sequenceid=6, compaction requested=false 2023-10-02 13:04:06,171 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-02 13:04:06,171 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-02 13:04:06,174 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 99c5e3453fe69f7d8c97baa61633a333: 2023-10-02 13:04:06,174 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ca6b342eaf041af2fa804f131f4dd3c: 2023-10-02 13:04:06,175 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,175 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,175 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:04:06,175 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 13:04:06,175 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/cf/01e3e5ffcb6f483cb4b032e7a62ac583] hfiles 2023-10-02 13:04:06,175 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/cf/7fb222d761b84ea1ac7caed298a0e03b] hfiles 2023-10-02 13:04:06,175 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/cf/7fb222d761b84ea1ac7caed298a0e03b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,175 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/cf/01e3e5ffcb6f483cb4b032e7a62ac583 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,182 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. completed. 2023-10-02 13:04:06,182 DEBUG [rs(jenkins-hbase4.apache.org,46551,1696251745482)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:04:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:04:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,182 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. completed. 2023-10-02 13:04:06,182 DEBUG [rs(jenkins-hbase4.apache.org,46465,1696251745531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 13:04:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46551,1696251745482' in zk 2023-10-02 13:04:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 13:04:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 13:04:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 13:04:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46465,1696251745531' in zk 2023-10-02 13:04:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 13:04:06,184 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:04:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,46551,1696251745482' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 13:04:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:04:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:04:06,185 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,185 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 13:04:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:04:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,46465,1696251745531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 13:04:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:04:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:04:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:04:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46551,1696251745482': 2023-10-02 13:04:06,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46551,1696251745482' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-02 13:04:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:04:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:04:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:04:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:04:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:04:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46465,1696251745531': 2023-10-02 13:04:06,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46465,1696251745531' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-02 13:04:06,192 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-02 13:04:06,192 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 13:04:06,192 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 13:04:06,192 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,192 INFO [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 13:04:06,194 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,194 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,194 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,194 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,194 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 13:04:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 13:04:06,194 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:06,195 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,194 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:06,195 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 13:04:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:06,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:06,195 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 13:04:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 13:04:06,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,198 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,198 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,198 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:06,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:06,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:06,202 DEBUG [(jenkins-hbase4.apache.org,34719,1696251744198)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:06,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:06,204 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:04:06,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 13:04:06,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:06,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:06,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:06,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 13:04:06,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,202 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:06,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 13:04:06,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:06,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:06,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 13:04:06,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 13:04:06,204 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,205 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:06,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 13:04:06,205 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:06,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-02 13:04:06,205 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,205 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,205 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 13:04:06,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100289d6b8f88b854bfab6399268dccd0b81, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002c8414474b8244765b0da4dece5122f4a] mob files 2023-10-02 13:04:06,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100289d6b8f88b854bfab6399268dccd0b81 2023-10-02 13:04:06,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002c8414474b8244765b0da4dece5122f4a 2023-10-02 13:04:06,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,228 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-02 13:04:06,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,228 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696251846100Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696251846211 (+111 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696251846211Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696251846212 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696251846214 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696251846221 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696251846228 (+7 ms) 2023-10-02 13:04:06,231 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 13:04:06,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 130 msec 2023-10-02 13:04:06,405 DEBUG [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 13:04:06,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 13:04:06,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 13:04:06,407 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251846407 2023-10-02 13:04:06,407 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35861, tgtDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251846407, rawTgtDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251846407, srcFsUri=hdfs://localhost:35861, srcDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:04:06,429 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c 2023-10-02 13:04:06,429 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_657809081_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251846407, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251846407/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,429 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35861, inputRoot=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c, snapshotDir=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-02 13:04:06,437 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251846407/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:06,453 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:06,454 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:06,454 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:06,454 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:07,345 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-7604821807183864907.jar 2023-10-02 13:04:07,345 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:07,346 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:07,413 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/hadoop-2484971277952530255.jar 2023-10-02 13:04:07,414 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:07,414 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:07,414 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:07,415 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:07,415 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:07,415 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 13:04:07,416 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 13:04:07,416 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 13:04:07,416 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 13:04:07,417 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 13:04:07,417 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 13:04:07,418 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 13:04:07,418 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 13:04:07,418 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 13:04:07,418 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 13:04:07,419 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 13:04:07,419 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:04:07,420 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:04:07,420 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:04:07,420 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:04:07,421 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 13:04:07,421 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:04:07,422 DEBUG [Listener at jenkins-hbase4.apache.org/39417] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 13:04:07,769 WARN [Listener at jenkins-hbase4.apache.org/39417] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 13:04:07,771 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-02 13:04:07,773 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-02 13:04:08,764 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:04:08,764 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 13:04:08,770 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0006_000001 (auth:SIMPLE) 2023-10-02 13:04:09,182 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0007_000001 (auth:SIMPLE) 2023-10-02 13:04:10,392 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 13:04:12,956 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0007_000001 (auth:SIMPLE) 2023-10-02 13:04:15,169 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0007_000001 (auth:SIMPLE) 2023-10-02 13:04:17,777 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0007_000001 (auth:SIMPLE) 2023-10-02 13:04:18,939 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 13:04:18,940 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 13:04:18,951 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:18,951 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 13:04:18,952 INFO [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 13:04:18,952 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:18,952 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-02 13:04:18,952 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-02 13:04:18,952 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1563281491_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251846407/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251846407/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:18,953 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251846407/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-02 13:04:18,953 DEBUG [Listener at jenkins-hbase4.apache.org/39417] snapshot.TestExportSnapshot(367): hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/export-test/export-1696251846407/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-02 13:04:18,959 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:18,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:18,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:18,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 13:04:18,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251858963"}]},"ts":"1696251858963"} 2023-10-02 13:04:18,964 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-02 13:04:18,966 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-02 13:04:18,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=99c5e3453fe69f7d8c97baa61633a333, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ca6b342eaf041af2fa804f131f4dd3c, UNASSIGN}] 2023-10-02 13:04:18,969 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=99c5e3453fe69f7d8c97baa61633a333, UNASSIGN 2023-10-02 13:04:18,969 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ca6b342eaf041af2fa804f131f4dd3c, UNASSIGN 2023-10-02 13:04:18,970 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=99c5e3453fe69f7d8c97baa61633a333, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:18,970 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=4ca6b342eaf041af2fa804f131f4dd3c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:18,970 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696251858970"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251858970"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251858970"}]},"ts":"1696251858970"} 2023-10-02 13:04:18,970 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696251858970"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696251858970"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696251858970"}]},"ts":"1696251858970"} 2023-10-02 13:04:18,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 99c5e3453fe69f7d8c97baa61633a333, server=jenkins-hbase4.apache.org,46551,1696251745482}] 2023-10-02 13:04:18,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 4ca6b342eaf041af2fa804f131f4dd3c, server=jenkins-hbase4.apache.org,46465,1696251745531}] 2023-10-02 13:04:19,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 13:04:19,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:19,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 99c5e3453fe69f7d8c97baa61633a333, disabling compactions & flushes 2023-10-02 13:04:19,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:19,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:19,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. after waiting 0 ms 2023-10-02 13:04:19,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:19,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:19,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4ca6b342eaf041af2fa804f131f4dd3c, disabling compactions & flushes 2023-10-02 13:04:19,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:19,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:19,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. after waiting 0 ms 2023-10-02 13:04:19,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:19,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:04:19,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:04:19,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:19,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333. 2023-10-02 13:04:19,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 99c5e3453fe69f7d8c97baa61633a333: 2023-10-02 13:04:19,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:19,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c. 2023-10-02 13:04:19,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4ca6b342eaf041af2fa804f131f4dd3c: 2023-10-02 13:04:19,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:19,140 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=99c5e3453fe69f7d8c97baa61633a333, regionState=CLOSED 2023-10-02 13:04:19,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:19,141 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696251859140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251859140"}]},"ts":"1696251859140"} 2023-10-02 13:04:19,141 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=4ca6b342eaf041af2fa804f131f4dd3c, regionState=CLOSED 2023-10-02 13:04:19,141 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696251859141"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696251859141"}]},"ts":"1696251859141"} 2023-10-02 13:04:19,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-02 13:04:19,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 99c5e3453fe69f7d8c97baa61633a333, server=jenkins-hbase4.apache.org,46551,1696251745482 in 171 msec 2023-10-02 13:04:19,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-02 13:04:19,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 4ca6b342eaf041af2fa804f131f4dd3c, server=jenkins-hbase4.apache.org,46465,1696251745531 in 170 msec 2023-10-02 13:04:19,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=99c5e3453fe69f7d8c97baa61633a333, UNASSIGN in 179 msec 2023-10-02 13:04:19,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-02 13:04:19,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ca6b342eaf041af2fa804f131f4dd3c, UNASSIGN in 179 msec 2023-10-02 13:04:19,148 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696251859148"}]},"ts":"1696251859148"} 2023-10-02 13:04:19,149 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-02 13:04:19,150 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-02 13:04:19,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 192 msec 2023-10-02 13:04:19,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 13:04:19,265 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-02 13:04:19,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,269 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,270 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,271 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33895] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,273 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:19,273 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:19,274 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,275 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,275 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,275 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 13:04:19,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 13:04:19,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 13:04:19,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 13:04:19,276 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/recovered.edits] 2023-10-02 13:04:19,276 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/cf, FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/recovered.edits] 2023-10-02 13:04:19,277 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,277 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,277 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,277 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:19,277 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,277 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:19,277 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:19,277 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 13:04:19,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-02 13:04:19,280 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/cf/01e3e5ffcb6f483cb4b032e7a62ac583 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/cf/01e3e5ffcb6f483cb4b032e7a62ac583 2023-10-02 13:04:19,280 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/cf/7fb222d761b84ea1ac7caed298a0e03b to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/cf/7fb222d761b84ea1ac7caed298a0e03b 2023-10-02 13:04:19,283 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333/recovered.edits/9.seqid 2023-10-02 13:04:19,284 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/recovered.edits/9.seqid to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c/recovered.edits/9.seqid 2023-10-02 13:04:19,284 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/99c5e3453fe69f7d8c97baa61633a333 2023-10-02 13:04:19,284 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ca6b342eaf041af2fa804f131f4dd3c 2023-10-02 13:04:19,284 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-02 13:04:19,285 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-02 13:04:19,285 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-02 13:04:19,288 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100289d6b8f88b854bfab6399268dccd0b81 to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100289d6b8f88b854bfab6399268dccd0b81 2023-10-02 13:04:19,290 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002c8414474b8244765b0da4dece5122f4a to hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231002c8414474b8244765b0da4dece5122f4a 2023-10-02 13:04:19,290 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-02 13:04:19,292 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,294 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-02 13:04:19,295 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-02 13:04:19,296 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,296 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-02 13:04:19,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251859296"}]},"ts":"9223372036854775807"} 2023-10-02 13:04:19,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696251859296"}]},"ts":"9223372036854775807"} 2023-10-02 13:04:19,298 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 13:04:19,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 99c5e3453fe69f7d8c97baa61633a333, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696251845085.99c5e3453fe69f7d8c97baa61633a333.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4ca6b342eaf041af2fa804f131f4dd3c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696251845085.4ca6b342eaf041af2fa804f131f4dd3c.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 13:04:19,298 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-02 13:04:19,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696251859298"}]},"ts":"9223372036854775807"} 2023-10-02 13:04:19,300 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-02 13:04:19,301 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 36 msec 2023-10-02 13:04:19,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-02 13:04:19,379 INFO [Listener at jenkins-hbase4.apache.org/39417] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-02 13:04:19,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-02 13:04:19,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-02 13:04:19,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34719] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 13:04:19,416 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 767), OpenFileDescriptor=913 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=171 (was 193), ProcessCount=167 (was 167), AvailableMemoryMB=1187 (was 1285) 2023-10-02 13:04:19,416 WARN [Listener at jenkins-hbase4.apache.org/39417] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-02 13:04:19,416 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-02 13:04:19,427 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 13:04:23,958 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696251752115_0007_000001 (auth:SIMPLE) 2023-10-02 13:04:24,709 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 13:04:33,553 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 13:04:47,673 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 13:04:47,674 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 13:04:47,787 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-02 13:04:47,794 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-02 13:04:47,795 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 13:04:47,804 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 13:04:47,908 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 13:04:47,908 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-02 13:04:47,908 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-02 13:04:47,908 INFO [Listener at jenkins-hbase4.apache.org/39417] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-02 13:04:47,908 DEBUG [Listener at jenkins-hbase4.apache.org/39417] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28ba846e to 127.0.0.1:55009 2023-10-02 13:04:47,908 DEBUG [Listener at jenkins-hbase4.apache.org/39417] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:47,908 DEBUG [Listener at jenkins-hbase4.apache.org/39417] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-02 13:04:47,908 DEBUG [Listener at jenkins-hbase4.apache.org/39417] util.JVMClusterUtil(257): Found active master hash=526508247, stopped=false 2023-10-02 13:04:47,909 DEBUG [Listener at jenkins-hbase4.apache.org/39417] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:47,909 DEBUG [Listener at jenkins-hbase4.apache.org/39417] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-02 13:04:47,909 INFO [Listener at jenkins-hbase4.apache.org/39417] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34719,1696251744198 2023-10-02 13:04:47,911 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 13:04:47,911 INFO [Listener at jenkins-hbase4.apache.org/39417] procedure2.ProcedureExecutor(628): Stopping 2023-10-02 13:04:47,911 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 13:04:47,911 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 13:04:47,911 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 13:04:47,911 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:04:47,911 DEBUG [Listener at jenkins-hbase4.apache.org/39417] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a801a58 to 127.0.0.1:55009 2023-10-02 13:04:47,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 13:04:47,911 DEBUG [Listener at jenkins-hbase4.apache.org/39417] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:47,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 13:04:47,912 INFO [Listener at jenkins-hbase4.apache.org/39417] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46551,1696251745482' ***** 2023-10-02 13:04:47,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 13:04:47,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 13:04:47,912 DEBUG [Listener at jenkins-hbase4.apache.org/39417] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:47,912 INFO [Listener at jenkins-hbase4.apache.org/39417] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 13:04:47,912 INFO [Listener at jenkins-hbase4.apache.org/39417] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46465,1696251745531' ***** 2023-10-02 13:04:47,912 DEBUG [Listener at jenkins-hbase4.apache.org/39417] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:47,912 INFO [RS:0;jenkins-hbase4:46551] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 13:04:47,912 INFO [Listener at jenkins-hbase4.apache.org/39417] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 13:04:47,912 INFO [Listener at jenkins-hbase4.apache.org/39417] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33895,1696251745577' ***** 2023-10-02 13:04:47,912 DEBUG [Listener at jenkins-hbase4.apache.org/39417] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:47,912 INFO [RS:0;jenkins-hbase4:46551] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 13:04:47,912 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 13:04:47,912 INFO [RS:1;jenkins-hbase4:46465] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 13:04:47,912 INFO [Listener at jenkins-hbase4.apache.org/39417] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 13:04:47,913 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 13:04:47,913 INFO [RS:1;jenkins-hbase4:46465] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 13:04:47,913 INFO [RS:1;jenkins-hbase4:46465] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 13:04:47,913 INFO [RS:2;jenkins-hbase4:33895] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 13:04:47,913 INFO [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:47,913 INFO [RS:2;jenkins-hbase4:33895] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 13:04:47,913 INFO [RS:0;jenkins-hbase4:46551] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 13:04:47,913 INFO [RS:2;jenkins-hbase4:33895] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 13:04:47,913 DEBUG [RS:1;jenkins-hbase4:46465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7af20f95 to 127.0.0.1:55009 2023-10-02 13:04:47,913 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 13:04:47,913 INFO [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(3305): Received CLOSE for 46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:04:47,913 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(3305): Received CLOSE for a53f766656abbd282f03313f644ecac4 2023-10-02 13:04:47,913 DEBUG [RS:1;jenkins-hbase4:46465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:47,916 INFO [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46465,1696251745531; all regions closed. 2023-10-02 13:04:47,916 INFO [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:47,916 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:47,916 DEBUG [RS:2;jenkins-hbase4:33895] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a04b44d to 127.0.0.1:55009 2023-10-02 13:04:47,916 DEBUG [RS:0;jenkins-hbase4:46551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7889fb15 to 127.0.0.1:55009 2023-10-02 13:04:47,917 DEBUG [RS:2;jenkins-hbase4:33895] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:47,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a53f766656abbd282f03313f644ecac4, disabling compactions & flushes 2023-10-02 13:04:47,917 INFO [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-02 13:04:47,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 46df02ef17bee4370efaec1a2daae64f, disabling compactions & flushes 2023-10-02 13:04:47,917 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1478): Online Regions={46df02ef17bee4370efaec1a2daae64f=hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f.} 2023-10-02 13:04:47,917 DEBUG [RS:0;jenkins-hbase4:46551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:47,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:04:47,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:04:47,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:04:47,918 INFO [RS:0;jenkins-hbase4:46551] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 13:04:47,918 INFO [RS:0;jenkins-hbase4:46551] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 13:04:47,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:04:47,918 INFO [RS:0;jenkins-hbase4:46551] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 13:04:47,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. after waiting 0 ms 2023-10-02 13:04:47,918 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-02 13:04:47,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. after waiting 0 ms 2023-10-02 13:04:47,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:04:47,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:04:47,918 DEBUG [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1504): Waiting on 46df02ef17bee4370efaec1a2daae64f 2023-10-02 13:04:47,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a53f766656abbd282f03313f644ecac4 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-02 13:04:47,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 46df02ef17bee4370efaec1a2daae64f 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-02 13:04:47,918 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-02 13:04:47,919 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1478): Online Regions={a53f766656abbd282f03313f644ecac4=hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4., 1588230740=hbase:meta,,1.1588230740} 2023-10-02 13:04:47,919 DEBUG [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1504): Waiting on 1588230740, a53f766656abbd282f03313f644ecac4 2023-10-02 13:04:47,919 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-02 13:04:47,919 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-02 13:04:47,919 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-02 13:04:47,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-02 13:04:47,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-02 13:04:47,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-02 13:04:47,936 DEBUG [RS:1;jenkins-hbase4:46465] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/oldWALs 2023-10-02 13:04:47,936 INFO [RS:1;jenkins-hbase4:46465] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46465%2C1696251745531:(num 1696251747262) 2023-10-02 13:04:47,936 DEBUG [RS:1;jenkins-hbase4:46465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:47,936 INFO [RS:1;jenkins-hbase4:46465] regionserver.LeaseManager(133): Closed leases 2023-10-02 13:04:47,937 INFO [RS:1;jenkins-hbase4:46465] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-02 13:04:47,937 INFO [RS:1;jenkins-hbase4:46465] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 13:04:47,937 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 13:04:47,937 INFO [RS:1;jenkins-hbase4:46465] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 13:04:47,937 INFO [RS:1;jenkins-hbase4:46465] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 13:04:47,946 INFO [RS:1;jenkins-hbase4:46465] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46465 2023-10-02 13:04:47,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/.tmp/info/83fe6d2439604d6d80a268d4bfc3ac6b 2023-10-02 13:04:47,958 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 13:04:47,958 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:47,958 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:47,958 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46465,1696251745531 2023-10-02 13:04:47,958 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 13:04:47,958 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 13:04:47,958 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 13:04:47,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/namespace/a53f766656abbd282f03313f644ecac4/.tmp/info/da123d10de9f4b358f4911cdcbc123f2 2023-10-02 13:04:47,960 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46465,1696251745531] 2023-10-02 13:04:47,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f/.tmp/l/ebba9fc7f2d64df0a615a5ecafa67530 2023-10-02 13:04:47,961 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46465,1696251745531; numProcessing=1 2023-10-02 13:04:47,964 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46465,1696251745531 already deleted, retry=false 2023-10-02 13:04:47,964 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46465,1696251745531 expired; onlineServers=2 2023-10-02 13:04:47,965 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83fe6d2439604d6d80a268d4bfc3ac6b 2023-10-02 13:04:47,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebba9fc7f2d64df0a615a5ecafa67530 2023-10-02 13:04:47,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f/.tmp/l/ebba9fc7f2d64df0a615a5ecafa67530 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f/l/ebba9fc7f2d64df0a615a5ecafa67530 2023-10-02 13:04:47,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/namespace/a53f766656abbd282f03313f644ecac4/.tmp/info/da123d10de9f4b358f4911cdcbc123f2 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/namespace/a53f766656abbd282f03313f644ecac4/info/da123d10de9f4b358f4911cdcbc123f2 2023-10-02 13:04:47,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebba9fc7f2d64df0a615a5ecafa67530 2023-10-02 13:04:47,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f/l/ebba9fc7f2d64df0a615a5ecafa67530, entries=7, sequenceid=18, filesize=5.2 K 2023-10-02 13:04:47,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/namespace/a53f766656abbd282f03313f644ecac4/info/da123d10de9f4b358f4911cdcbc123f2, entries=2, sequenceid=6, filesize=4.8 K 2023-10-02 13:04:47,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 46df02ef17bee4370efaec1a2daae64f in 55ms, sequenceid=18, compaction requested=false 2023-10-02 13:04:47,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a53f766656abbd282f03313f644ecac4 in 56ms, sequenceid=6, compaction requested=false 2023-10-02 13:04:47,985 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/.tmp/rep_barrier/9fdadc480be04debaa2c3a8bab18e037 2023-10-02 13:04:47,989 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9fdadc480be04debaa2c3a8bab18e037 2023-10-02 13:04:47,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/namespace/a53f766656abbd282f03313f644ecac4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 13:04:47,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/acl/46df02ef17bee4370efaec1a2daae64f/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-02 13:04:47,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:47,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:47,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:04:47,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 46df02ef17bee4370efaec1a2daae64f: 2023-10-02 13:04:47,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:04:47,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a53f766656abbd282f03313f644ecac4: 2023-10-02 13:04:47,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696251748509.46df02ef17bee4370efaec1a2daae64f. 2023-10-02 13:04:47,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696251747752.a53f766656abbd282f03313f644ecac4. 2023-10-02 13:04:47,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/.tmp/table/7560811c19584bed83f53208835720ac 2023-10-02 13:04:48,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7560811c19584bed83f53208835720ac 2023-10-02 13:04:48,003 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/.tmp/info/83fe6d2439604d6d80a268d4bfc3ac6b as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/info/83fe6d2439604d6d80a268d4bfc3ac6b 2023-10-02 13:04:48,006 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83fe6d2439604d6d80a268d4bfc3ac6b 2023-10-02 13:04:48,006 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/info/83fe6d2439604d6d80a268d4bfc3ac6b, entries=48, sequenceid=131, filesize=10.3 K 2023-10-02 13:04:48,007 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/.tmp/rep_barrier/9fdadc480be04debaa2c3a8bab18e037 as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/rep_barrier/9fdadc480be04debaa2c3a8bab18e037 2023-10-02 13:04:48,011 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9fdadc480be04debaa2c3a8bab18e037 2023-10-02 13:04:48,011 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 13:04:48,011 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 13:04:48,011 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 13:04:48,011 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/rep_barrier/9fdadc480be04debaa2c3a8bab18e037, entries=13, sequenceid=131, filesize=6.4 K 2023-10-02 13:04:48,012 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/.tmp/table/7560811c19584bed83f53208835720ac as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/table/7560811c19584bed83f53208835720ac 2023-10-02 13:04:48,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7560811c19584bed83f53208835720ac 2023-10-02 13:04:48,016 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/table/7560811c19584bed83f53208835720ac, entries=24, sequenceid=131, filesize=6.9 K 2023-10-02 13:04:48,016 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 96ms, sequenceid=131, compaction requested=false 2023-10-02 13:04:48,025 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-02 13:04:48,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 13:04:48,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-02 13:04:48,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-02 13:04:48,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-02 13:04:48,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-02 13:04:48,060 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 13:04:48,060 INFO [RS:1;jenkins-hbase4:46465] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46465,1696251745531; zookeeper connection closed. 2023-10-02 13:04:48,060 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46465-0x101073ac3840002, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 13:04:48,061 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@38b2487d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@38b2487d 2023-10-02 13:04:48,103 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-02 13:04:48,103 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-02 13:04:48,113 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-02 13:04:48,114 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-02 13:04:48,119 INFO [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33895,1696251745577; all regions closed. 2023-10-02 13:04:48,119 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46551,1696251745482; all regions closed. 2023-10-02 13:04:48,126 DEBUG [RS:2;jenkins-hbase4:33895] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/oldWALs 2023-10-02 13:04:48,126 DEBUG [RS:0;jenkins-hbase4:46551] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/oldWALs 2023-10-02 13:04:48,126 INFO [RS:0;jenkins-hbase4:46551] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46551%2C1696251745482.meta:.meta(num 1696251747439) 2023-10-02 13:04:48,126 INFO [RS:2;jenkins-hbase4:33895] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33895%2C1696251745577:(num 1696251747270) 2023-10-02 13:04:48,126 DEBUG [RS:2;jenkins-hbase4:33895] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:48,126 INFO [RS:2;jenkins-hbase4:33895] regionserver.LeaseManager(133): Closed leases 2023-10-02 13:04:48,127 INFO [RS:2;jenkins-hbase4:33895] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-02 13:04:48,127 INFO [RS:2;jenkins-hbase4:33895] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 13:04:48,127 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 13:04:48,127 INFO [RS:2;jenkins-hbase4:33895] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 13:04:48,127 INFO [RS:2;jenkins-hbase4:33895] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 13:04:48,128 INFO [RS:2;jenkins-hbase4:33895] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33895 2023-10-02 13:04:48,131 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:48,131 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 13:04:48,131 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33895,1696251745577 2023-10-02 13:04:48,132 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33895,1696251745577] 2023-10-02 13:04:48,132 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33895,1696251745577; numProcessing=2 2023-10-02 13:04:48,133 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33895,1696251745577 already deleted, retry=false 2023-10-02 13:04:48,133 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33895,1696251745577 expired; onlineServers=1 2023-10-02 13:04:48,134 DEBUG [RS:0;jenkins-hbase4:46551] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/oldWALs 2023-10-02 13:04:48,134 INFO [RS:0;jenkins-hbase4:46551] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46551%2C1696251745482:(num 1696251747271) 2023-10-02 13:04:48,134 DEBUG [RS:0;jenkins-hbase4:46551] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:48,134 INFO [RS:0;jenkins-hbase4:46551] regionserver.LeaseManager(133): Closed leases 2023-10-02 13:04:48,134 INFO [RS:0;jenkins-hbase4:46551] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-02 13:04:48,135 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 13:04:48,135 INFO [RS:0;jenkins-hbase4:46551] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46551 2023-10-02 13:04:48,140 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46551,1696251745482 2023-10-02 13:04:48,140 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 13:04:48,141 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46551,1696251745482] 2023-10-02 13:04:48,141 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46551,1696251745482; numProcessing=3 2023-10-02 13:04:48,142 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46551,1696251745482 already deleted, retry=false 2023-10-02 13:04:48,142 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46551,1696251745482 expired; onlineServers=0 2023-10-02 13:04:48,142 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34719,1696251744198' ***** 2023-10-02 13:04:48,142 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-02 13:04:48,143 DEBUG [M:0;jenkins-hbase4:34719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e5ceaec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 13:04:48,143 INFO [M:0;jenkins-hbase4:34719] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34719,1696251744198 2023-10-02 13:04:48,143 INFO [M:0;jenkins-hbase4:34719] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34719,1696251744198; all regions closed. 2023-10-02 13:04:48,143 DEBUG [M:0;jenkins-hbase4:34719] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 13:04:48,143 DEBUG [M:0;jenkins-hbase4:34719] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-02 13:04:48,143 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-02 13:04:48,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696251746900] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696251746900,5,FailOnTimeoutGroup] 2023-10-02 13:04:48,143 DEBUG [M:0;jenkins-hbase4:34719] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-02 13:04:48,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696251746900] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696251746900,5,FailOnTimeoutGroup] 2023-10-02 13:04:48,143 INFO [M:0;jenkins-hbase4:34719] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-02 13:04:48,143 INFO [M:0;jenkins-hbase4:34719] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-02 13:04:48,143 INFO [M:0;jenkins-hbase4:34719] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-02 13:04:48,144 DEBUG [M:0;jenkins-hbase4:34719] master.HMaster(1512): Stopping service threads 2023-10-02 13:04:48,144 INFO [M:0;jenkins-hbase4:34719] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-02 13:04:48,144 ERROR [M:0;jenkins-hbase4:34719] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-02 13:04:48,144 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-02 13:04:48,144 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 13:04:48,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 13:04:48,145 INFO [M:0;jenkins-hbase4:34719] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-02 13:04:48,145 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-02 13:04:48,145 DEBUG [M:0;jenkins-hbase4:34719] zookeeper.ZKUtil(398): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-02 13:04:48,145 WARN [M:0;jenkins-hbase4:34719] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-02 13:04:48,145 INFO [M:0;jenkins-hbase4:34719] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-02 13:04:48,145 INFO [M:0;jenkins-hbase4:34719] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-02 13:04:48,146 DEBUG [M:0;jenkins-hbase4:34719] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-02 13:04:48,146 INFO [M:0;jenkins-hbase4:34719] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 13:04:48,146 DEBUG [M:0;jenkins-hbase4:34719] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 13:04:48,146 DEBUG [M:0;jenkins-hbase4:34719] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-02 13:04:48,146 DEBUG [M:0;jenkins-hbase4:34719] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 13:04:48,146 INFO [M:0;jenkins-hbase4:34719] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.62 KB heapSize=451.90 KB 2023-10-02 13:04:48,159 INFO [M:0;jenkins-hbase4:34719] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.62 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/49cf66a1737143619d011046de2a676d 2023-10-02 13:04:48,163 INFO [M:0;jenkins-hbase4:34719] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49cf66a1737143619d011046de2a676d 2023-10-02 13:04:48,163 DEBUG [M:0;jenkins-hbase4:34719] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/49cf66a1737143619d011046de2a676d as hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/49cf66a1737143619d011046de2a676d 2023-10-02 13:04:48,168 INFO [M:0;jenkins-hbase4:34719] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49cf66a1737143619d011046de2a676d 2023-10-02 13:04:48,168 INFO [M:0;jenkins-hbase4:34719] regionserver.HStore(1080): Added hdfs://localhost:35861/user/jenkins/test-data/8303124e-8b99-9adf-5fa2-44bc45cded9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/49cf66a1737143619d011046de2a676d, entries=119, sequenceid=899, filesize=28.6 K 2023-10-02 13:04:48,169 INFO [M:0;jenkins-hbase4:34719] regionserver.HRegion(2948): Finished flush of dataSize ~375.62 KB/384634, heapSize ~451.88 KB/462728, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-10-02 13:04:48,171 INFO [M:0;jenkins-hbase4:34719] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 13:04:48,171 DEBUG [M:0;jenkins-hbase4:34719] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 13:04:48,175 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 13:04:48,175 INFO [M:0;jenkins-hbase4:34719] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-02 13:04:48,175 INFO [M:0;jenkins-hbase4:34719] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34719 2023-10-02 13:04:48,178 DEBUG [M:0;jenkins-hbase4:34719] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34719,1696251744198 already deleted, retry=false 2023-10-02 13:04:48,233 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 13:04:48,233 INFO [RS:2;jenkins-hbase4:33895] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33895,1696251745577; zookeeper connection closed. 2023-10-02 13:04:48,233 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:33895-0x101073ac3840003, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 13:04:48,233 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@48d7532f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@48d7532f 2023-10-02 13:04:48,333 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 13:04:48,333 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): master:34719-0x101073ac3840000, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 13:04:48,333 INFO [M:0;jenkins-hbase4:34719] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34719,1696251744198; zookeeper connection closed. 2023-10-02 13:04:48,433 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 13:04:48,433 INFO [RS:0;jenkins-hbase4:46551] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46551,1696251745482; zookeeper connection closed. 2023-10-02 13:04:48,433 DEBUG [Listener at localhost/39941-EventThread] zookeeper.ZKWatcher(600): regionserver:46551-0x101073ac3840001, quorum=127.0.0.1:55009, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 13:04:48,434 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7f59be5c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7f59be5c 2023-10-02 13:04:48,434 INFO [Listener at jenkins-hbase4.apache.org/39417] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-02 13:04:48,434 WARN [Listener at jenkins-hbase4.apache.org/39417] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 13:04:48,437 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 13:04:48,540 WARN [BP-924857854-172.31.14.131-1696251740355 heartbeating to localhost/127.0.0.1:35861] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 13:04:48,540 WARN [BP-924857854-172.31.14.131-1696251740355 heartbeating to localhost/127.0.0.1:35861] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-924857854-172.31.14.131-1696251740355 (Datanode Uuid bb8e0acc-9b06-498b-8ff2-a86cdbf263da) service to localhost/127.0.0.1:35861 2023-10-02 13:04:48,542 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data5/current/BP-924857854-172.31.14.131-1696251740355] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 13:04:48,542 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data6/current/BP-924857854-172.31.14.131-1696251740355] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 13:04:48,544 WARN [Listener at jenkins-hbase4.apache.org/39417] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 13:04:48,546 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 13:04:48,649 WARN [BP-924857854-172.31.14.131-1696251740355 heartbeating to localhost/127.0.0.1:35861] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 13:04:48,649 WARN [BP-924857854-172.31.14.131-1696251740355 heartbeating to localhost/127.0.0.1:35861] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-924857854-172.31.14.131-1696251740355 (Datanode Uuid ae2e7fea-8e65-4ccc-a1df-12a1627ce501) service to localhost/127.0.0.1:35861 2023-10-02 13:04:48,650 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data3/current/BP-924857854-172.31.14.131-1696251740355] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 13:04:48,650 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data4/current/BP-924857854-172.31.14.131-1696251740355] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 13:04:48,651 WARN [Listener at jenkins-hbase4.apache.org/39417] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 13:04:48,653 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 13:04:48,756 WARN [BP-924857854-172.31.14.131-1696251740355 heartbeating to localhost/127.0.0.1:35861] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 13:04:48,757 WARN [BP-924857854-172.31.14.131-1696251740355 heartbeating to localhost/127.0.0.1:35861] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-924857854-172.31.14.131-1696251740355 (Datanode Uuid 72b1ad61-0944-477b-837c-744ba1f5e3eb) service to localhost/127.0.0.1:35861 2023-10-02 13:04:48,757 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data1/current/BP-924857854-172.31.14.131-1696251740355] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 13:04:48,757 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ccb4866d-c3d5-e88c-8dfd-fca81f9dc74b/cluster_132a1bf7-ee4e-c885-d4d7-ba8a186ea3d1/dfs/data/data2/current/BP-924857854-172.31.14.131-1696251740355] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 13:04:48,778 INFO [Listener at jenkins-hbase4.apache.org/39417] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 13:04:48,904 INFO [Listener at jenkins-hbase4.apache.org/39417] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-02 13:04:48,998 INFO [Listener at jenkins-hbase4.apache.org/39417] hbase.HBaseTestingUtility(1293): Minicluster is down