2023-10-03 09:59:53,945 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-03 09:59:54,169 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8 2023-10-03 09:59:54,170 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-03 09:59:54,170 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-03 09:59:54,209 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-03 09:59:54,426 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-03 09:59:54,426 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8, deleteOnExit=true 2023-10-03 09:59:54,427 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-03 09:59:54,427 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/test.cache.data in system properties and HBase conf 2023-10-03 09:59:54,428 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop.tmp.dir in system properties and HBase conf 2023-10-03 09:59:54,429 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop.log.dir in system properties and HBase conf 2023-10-03 09:59:54,429 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-03 09:59:54,430 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-03 09:59:54,430 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-03 09:59:54,711 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-03 09:59:54,716 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-03 09:59:54,716 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-03 09:59:54,717 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-03 09:59:54,717 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-03 09:59:54,718 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-03 09:59:54,718 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-03 09:59:54,719 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-03 09:59:54,719 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-03 09:59:54,720 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-03 09:59:54,720 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/nfs.dump.dir in system properties and HBase conf 2023-10-03 09:59:54,721 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/java.io.tmpdir in system properties and HBase conf 2023-10-03 09:59:54,721 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-03 09:59:54,721 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-03 09:59:54,722 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-03 09:59:55,232 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-03 09:59:55,236 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-03 09:59:55,509 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-03 09:59:55,664 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-03 09:59:55,677 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-03 09:59:55,709 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-03 09:59:55,741 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/java.io.tmpdir/Jetty_localhost_38685_hdfs____.35sfmw/webapp 2023-10-03 09:59:55,867 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38685 2023-10-03 09:59:55,914 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-03 09:59:55,914 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-03 09:59:56,365 WARN [Listener at localhost/36071] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-03 09:59:56,449 WARN [Listener at localhost/36071] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-03 09:59:56,467 WARN [Listener at localhost/36071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-03 09:59:56,475 INFO [Listener at localhost/36071] log.Slf4jLog(67): jetty-6.1.26 2023-10-03 09:59:56,483 INFO [Listener at localhost/36071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/java.io.tmpdir/Jetty_localhost_33417_datanode____mtv5k1/webapp 2023-10-03 09:59:56,595 INFO [Listener at localhost/36071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33417 2023-10-03 09:59:57,003 WARN [Listener at localhost/44849] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-03 09:59:57,020 WARN [Listener at localhost/44849] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-03 09:59:57,024 WARN [Listener at localhost/44849] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-03 09:59:57,027 INFO [Listener at localhost/44849] log.Slf4jLog(67): jetty-6.1.26 2023-10-03 09:59:57,033 INFO [Listener at localhost/44849] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/java.io.tmpdir/Jetty_localhost_38277_datanode____mn7a0k/webapp 2023-10-03 09:59:57,136 INFO [Listener at localhost/44849] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38277 2023-10-03 09:59:57,148 WARN [Listener at localhost/43401] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-03 09:59:57,168 WARN [Listener at localhost/43401] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-03 09:59:57,170 WARN [Listener at localhost/43401] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-03 09:59:57,172 INFO [Listener at localhost/43401] log.Slf4jLog(67): jetty-6.1.26 2023-10-03 09:59:57,177 INFO [Listener at localhost/43401] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/java.io.tmpdir/Jetty_localhost_42107_datanode____.cs4j1b/webapp 2023-10-03 09:59:57,297 INFO [Listener at localhost/43401] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42107 2023-10-03 09:59:57,305 WARN [Listener at localhost/46481] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-03 09:59:57,504 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7bc126110a8ac436: Processing first storage report for DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13 from datanode 0b14d6ff-d02e-440e-bb0f-ee667635274a 2023-10-03 09:59:57,506 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7bc126110a8ac436: from storage DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13 node DatanodeRegistration(127.0.0.1:35435, datanodeUuid=0b14d6ff-d02e-440e-bb0f-ee667635274a, infoPort=37617, infoSecurePort=0, ipcPort=44849, storageInfo=lv=-57;cid=testClusterID;nsid=1723502919;c=1696327195303), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-03 09:59:57,506 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8edd227294baefc7: Processing first storage report for DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c from datanode 1362ae40-ee32-4844-b465-3511f35ded0a 2023-10-03 09:59:57,507 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8edd227294baefc7: from storage DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c node DatanodeRegistration(127.0.0.1:33203, datanodeUuid=1362ae40-ee32-4844-b465-3511f35ded0a, infoPort=38223, infoSecurePort=0, ipcPort=43401, storageInfo=lv=-57;cid=testClusterID;nsid=1723502919;c=1696327195303), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-03 09:59:57,507 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa997244a8c06a55e: Processing first storage report for DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e from datanode 325f566a-8c2b-4c0f-bc93-5013b3963475 2023-10-03 09:59:57,507 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa997244a8c06a55e: from storage DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e node DatanodeRegistration(127.0.0.1:36859, datanodeUuid=325f566a-8c2b-4c0f-bc93-5013b3963475, infoPort=39881, infoSecurePort=0, ipcPort=46481, storageInfo=lv=-57;cid=testClusterID;nsid=1723502919;c=1696327195303), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-03 09:59:57,507 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7bc126110a8ac436: Processing first storage report for DS-7a80b85e-0212-454a-ae21-cce510215f14 from datanode 0b14d6ff-d02e-440e-bb0f-ee667635274a 2023-10-03 09:59:57,507 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7bc126110a8ac436: from storage DS-7a80b85e-0212-454a-ae21-cce510215f14 node DatanodeRegistration(127.0.0.1:35435, datanodeUuid=0b14d6ff-d02e-440e-bb0f-ee667635274a, infoPort=37617, infoSecurePort=0, ipcPort=44849, storageInfo=lv=-57;cid=testClusterID;nsid=1723502919;c=1696327195303), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-03 09:59:57,508 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8edd227294baefc7: Processing first storage report for DS-7dfe38cc-2992-4649-8aa8-5276dfdb0c6c from datanode 1362ae40-ee32-4844-b465-3511f35ded0a 2023-10-03 09:59:57,508 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8edd227294baefc7: from storage DS-7dfe38cc-2992-4649-8aa8-5276dfdb0c6c node DatanodeRegistration(127.0.0.1:33203, datanodeUuid=1362ae40-ee32-4844-b465-3511f35ded0a, infoPort=38223, infoSecurePort=0, ipcPort=43401, storageInfo=lv=-57;cid=testClusterID;nsid=1723502919;c=1696327195303), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-03 09:59:57,508 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa997244a8c06a55e: Processing first storage report for DS-abc99981-44cd-4c36-8246-8c3e6cea7f33 from datanode 325f566a-8c2b-4c0f-bc93-5013b3963475 2023-10-03 09:59:57,508 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa997244a8c06a55e: from storage DS-abc99981-44cd-4c36-8246-8c3e6cea7f33 node DatanodeRegistration(127.0.0.1:36859, datanodeUuid=325f566a-8c2b-4c0f-bc93-5013b3963475, infoPort=39881, infoSecurePort=0, ipcPort=46481, storageInfo=lv=-57;cid=testClusterID;nsid=1723502919;c=1696327195303), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-03 09:59:57,677 DEBUG [Listener at localhost/46481] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8 2023-10-03 09:59:57,761 INFO [Listener at localhost/46481] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/zookeeper_0, clientPort=56716, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-03 09:59:57,779 INFO [Listener at localhost/46481] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56716 2023-10-03 09:59:57,791 INFO [Listener at localhost/46481] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 09:59:57,793 INFO [Listener at localhost/46481] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 09:59:58,481 INFO [Listener at localhost/46481] util.FSUtils(471): Created version file at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead with version=8 2023-10-03 09:59:58,481 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/hbase-staging 2023-10-03 09:59:58,833 INFO [Listener at localhost/46481] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-03 09:59:59,354 INFO [Listener at localhost/46481] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-03 09:59:59,396 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-03 09:59:59,397 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-03 09:59:59,397 INFO [Listener at localhost/46481] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-03 09:59:59,397 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-03 09:59:59,397 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-03 09:59:59,556 INFO [Listener at localhost/46481] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-03 09:59:59,631 DEBUG [Listener at localhost/46481] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-03 09:59:59,729 INFO [Listener at localhost/46481] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33857 2023-10-03 09:59:59,742 INFO [Listener at localhost/46481] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 09:59:59,744 INFO [Listener at localhost/46481] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 09:59:59,767 INFO [Listener at localhost/46481] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33857 connecting to ZooKeeper ensemble=127.0.0.1:56716 2023-10-03 09:59:59,813 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:338570x0, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-03 09:59:59,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33857-0x1010bba1bd60000 connected 2023-10-03 09:59:59,846 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-03 09:59:59,847 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-03 09:59:59,862 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-03 09:59:59,869 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33857 2023-10-03 09:59:59,870 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33857 2023-10-03 09:59:59,870 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33857 2023-10-03 09:59:59,871 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33857 2023-10-03 09:59:59,873 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33857 2023-10-03 09:59:59,879 INFO [Listener at localhost/46481] master.HMaster(444): hbase.rootdir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead, hbase.cluster.distributed=false 2023-10-03 09:59:59,943 INFO [Listener at localhost/46481] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-03 09:59:59,943 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-03 09:59:59,943 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-03 09:59:59,944 INFO [Listener at localhost/46481] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-03 09:59:59,944 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-03 09:59:59,944 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-03 09:59:59,948 INFO [Listener at localhost/46481] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-03 09:59:59,952 INFO [Listener at localhost/46481] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36133 2023-10-03 09:59:59,954 INFO [Listener at localhost/46481] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-03 09:59:59,961 INFO [Listener at localhost/46481] mob.MobFileCache(125): MobFileCache disabled 2023-10-03 09:59:59,962 INFO [Listener at localhost/46481] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 09:59:59,964 INFO [Listener at localhost/46481] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 09:59:59,966 INFO [Listener at localhost/46481] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36133 connecting to ZooKeeper ensemble=127.0.0.1:56716 2023-10-03 09:59:59,970 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:361330x0, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-03 09:59:59,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36133-0x1010bba1bd60001 connected 2023-10-03 09:59:59,971 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-03 09:59:59,972 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-03 09:59:59,973 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-03 09:59:59,974 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36133 2023-10-03 09:59:59,974 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36133 2023-10-03 09:59:59,974 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36133 2023-10-03 09:59:59,977 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36133 2023-10-03 09:59:59,981 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36133 2023-10-03 09:59:59,993 INFO [Listener at localhost/46481] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-03 09:59:59,994 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-03 09:59:59,994 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-03 09:59:59,994 INFO [Listener at localhost/46481] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-03 09:59:59,994 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-03 09:59:59,995 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-03 09:59:59,995 INFO [Listener at localhost/46481] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-03 09:59:59,996 INFO [Listener at localhost/46481] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42977 2023-10-03 09:59:59,997 INFO [Listener at localhost/46481] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-03 09:59:59,998 INFO [Listener at localhost/46481] mob.MobFileCache(125): MobFileCache disabled 2023-10-03 09:59:59,998 INFO [Listener at localhost/46481] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 10:00:00,000 INFO [Listener at localhost/46481] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 10:00:00,002 INFO [Listener at localhost/46481] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42977 connecting to ZooKeeper ensemble=127.0.0.1:56716 2023-10-03 10:00:00,007 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:429770x0, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-03 10:00:00,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42977-0x1010bba1bd60002 connected 2023-10-03 10:00:00,009 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-03 10:00:00,010 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-03 10:00:00,010 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-03 10:00:00,011 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42977 2023-10-03 10:00:00,012 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42977 2023-10-03 10:00:00,013 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42977 2023-10-03 10:00:00,017 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42977 2023-10-03 10:00:00,017 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42977 2023-10-03 10:00:00,030 INFO [Listener at localhost/46481] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-03 10:00:00,030 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-03 10:00:00,030 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-03 10:00:00,031 INFO [Listener at localhost/46481] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-03 10:00:00,031 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-03 10:00:00,031 INFO [Listener at localhost/46481] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-03 10:00:00,031 INFO [Listener at localhost/46481] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-03 10:00:00,032 INFO [Listener at localhost/46481] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34139 2023-10-03 10:00:00,033 INFO [Listener at localhost/46481] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-03 10:00:00,034 INFO [Listener at localhost/46481] mob.MobFileCache(125): MobFileCache disabled 2023-10-03 10:00:00,035 INFO [Listener at localhost/46481] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 10:00:00,037 INFO [Listener at localhost/46481] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 10:00:00,040 INFO [Listener at localhost/46481] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34139 connecting to ZooKeeper ensemble=127.0.0.1:56716 2023-10-03 10:00:00,044 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:341390x0, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-03 10:00:00,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34139-0x1010bba1bd60003 connected 2023-10-03 10:00:00,045 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-03 10:00:00,046 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-03 10:00:00,047 DEBUG [Listener at localhost/46481] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-03 10:00:00,047 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34139 2023-10-03 10:00:00,048 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34139 2023-10-03 10:00:00,048 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34139 2023-10-03 10:00:00,053 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34139 2023-10-03 10:00:00,053 DEBUG [Listener at localhost/46481] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34139 2023-10-03 10:00:00,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33857,1696327198658 2023-10-03 10:00:00,064 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-03 10:00:00,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33857,1696327198658 2023-10-03 10:00:00,085 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-03 10:00:00,085 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-03 10:00:00,085 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-03 10:00:00,085 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-03 10:00:00,086 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:00:00,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-03 10:00:00,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33857,1696327198658 from backup master directory 2023-10-03 10:00:00,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-03 10:00:00,098 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33857,1696327198658 2023-10-03 10:00:00,098 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-03 10:00:00,099 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-03 10:00:00,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33857,1696327198658 2023-10-03 10:00:00,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-03 10:00:00,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-03 10:00:00,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/hbase.id with ID: d1a7d28c-58fe-44de-8850-289c62936e72 2023-10-03 10:00:00,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-03 10:00:00,258 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:00:00,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x34e730b6 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:00,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73df4f9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:00,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-03 10:00:00,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-03 10:00:00,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-03 10:00:00,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-03 10:00:00,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-03 10:00:00,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-03 10:00:00,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-03 10:00:00,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/data/master/store-tmp 2023-10-03 10:00:00,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:00,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-03 10:00:00,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-03 10:00:00,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-03 10:00:00,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-03 10:00:00,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-03 10:00:00,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-03 10:00:00,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-03 10:00:00,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/WALs/jenkins-hbase4.apache.org,33857,1696327198658 2023-10-03 10:00:00,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33857%2C1696327198658, suffix=, logDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/WALs/jenkins-hbase4.apache.org,33857,1696327198658, archiveDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/oldWALs, maxLogs=10 2023-10-03 10:00:00,554 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33203,DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c,DISK] 2023-10-03 10:00:00,554 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36859,DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e,DISK] 2023-10-03 10:00:00,554 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13,DISK] 2023-10-03 10:00:00,562 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-03 10:00:00,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/WALs/jenkins-hbase4.apache.org,33857,1696327198658/jenkins-hbase4.apache.org%2C33857%2C1696327198658.1696327200505 2023-10-03 10:00:00,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36859,DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e,DISK], DatanodeInfoWithStorage[127.0.0.1:35435,DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13,DISK], DatanodeInfoWithStorage[127.0.0.1:33203,DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c,DISK]] 2023-10-03 10:00:00,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-03 10:00:00,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:00,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-03 10:00:00,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-03 10:00:00,699 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-03 10:00:00,707 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-03 10:00:00,735 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-03 10:00:00,748 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:00,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-03 10:00:00,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-03 10:00:00,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-03 10:00:00,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:00:00,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71111750, jitterRate=0.05964764952659607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:00:00,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-03 10:00:00,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-03 10:00:00,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-03 10:00:00,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-03 10:00:00,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-03 10:00:00,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-03 10:00:00,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-10-03 10:00:00,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-03 10:00:00,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-03 10:00:00,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-03 10:00:00,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-03 10:00:00,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-03 10:00:00,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-03 10:00:00,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-03 10:00:00,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-03 10:00:00,931 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:00:00,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-03 10:00:00,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-03 10:00:00,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-03 10:00:00,954 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-03 10:00:00,954 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-03 10:00:00,954 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-03 10:00:00,954 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-03 10:00:00,954 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:00:00,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33857,1696327198658, sessionid=0x1010bba1bd60000, setting cluster-up flag (Was=false) 2023-10-03 10:00:00,972 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:00:00,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-03 10:00:00,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33857,1696327198658 2023-10-03 10:00:00,987 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:00:00,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-03 10:00:00,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33857,1696327198658 2023-10-03 10:00:00,997 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp 2023-10-03 10:00:01,057 INFO [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(951): ClusterId : d1a7d28c-58fe-44de-8850-289c62936e72 2023-10-03 10:00:01,057 INFO [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(951): ClusterId : d1a7d28c-58fe-44de-8850-289c62936e72 2023-10-03 10:00:01,057 INFO [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(951): ClusterId : d1a7d28c-58fe-44de-8850-289c62936e72 2023-10-03 10:00:01,065 DEBUG [RS:0;jenkins-hbase4:36133] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-03 10:00:01,065 DEBUG [RS:2;jenkins-hbase4:34139] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-03 10:00:01,065 DEBUG [RS:1;jenkins-hbase4:42977] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-03 10:00:01,074 DEBUG [RS:1;jenkins-hbase4:42977] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-03 10:00:01,074 DEBUG [RS:0;jenkins-hbase4:36133] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-03 10:00:01,074 DEBUG [RS:2;jenkins-hbase4:34139] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-03 10:00:01,074 DEBUG [RS:0;jenkins-hbase4:36133] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-03 10:00:01,074 DEBUG [RS:1;jenkins-hbase4:42977] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-03 10:00:01,074 DEBUG [RS:2;jenkins-hbase4:34139] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-03 10:00:01,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-03 10:00:01,078 DEBUG [RS:1;jenkins-hbase4:42977] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-03 10:00:01,078 DEBUG [RS:0;jenkins-hbase4:36133] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-03 10:00:01,087 DEBUG [RS:2;jenkins-hbase4:34139] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-03 10:00:01,088 DEBUG [RS:1;jenkins-hbase4:42977] zookeeper.ReadOnlyZKClient(139): Connect 0x74cbd7c9 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:01,088 DEBUG [RS:0;jenkins-hbase4:36133] zookeeper.ReadOnlyZKClient(139): Connect 0x2996d17a to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:01,090 DEBUG [RS:2;jenkins-hbase4:34139] zookeeper.ReadOnlyZKClient(139): Connect 0x50ff074d to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:01,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:01,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-03 10:00:01,101 DEBUG [RS:1;jenkins-hbase4:42977] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31c95734, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:01,101 DEBUG [RS:1;jenkins-hbase4:42977] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@527cf3c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-03 10:00:01,121 DEBUG [RS:0;jenkins-hbase4:36133] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@538b1f27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:01,121 DEBUG [RS:2;jenkins-hbase4:34139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14e82497, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:01,121 DEBUG [RS:0;jenkins-hbase4:36133] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d61b0d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-03 10:00:01,122 DEBUG [RS:2;jenkins-hbase4:34139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58b3e51f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-03 10:00:01,132 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42977 2023-10-03 10:00:01,132 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36133 2023-10-03 10:00:01,136 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34139 2023-10-03 10:00:01,139 INFO [RS:0;jenkins-hbase4:36133] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-03 10:00:01,139 INFO [RS:0;jenkins-hbase4:36133] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-03 10:00:01,139 INFO [RS:1;jenkins-hbase4:42977] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-03 10:00:01,139 INFO [RS:2;jenkins-hbase4:34139] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-03 10:00:01,140 INFO [RS:1;jenkins-hbase4:42977] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-03 10:00:01,140 INFO [RS:2;jenkins-hbase4:34139] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-03 10:00:01,140 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-03 10:00:01,140 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-03 10:00:01,140 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-03 10:00:01,141 INFO [RS:2;jenkins-hbase4:34139] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:01,141 INFO [RS:0;jenkins-hbase4:36133] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:01,141 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1022): About to register with Master. 2023-10-03 10:00:01,141 INFO [RS:1;jenkins-hbase4:42977] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:01,142 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1022): About to register with Master. 2023-10-03 10:00:01,141 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1022): About to register with Master. 2023-10-03 10:00:01,144 INFO [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33857,1696327198658 with isa=jenkins-hbase4.apache.org/172.31.14.131:36133, startcode=1696327199942 2023-10-03 10:00:01,144 INFO [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33857,1696327198658 with isa=jenkins-hbase4.apache.org/172.31.14.131:34139, startcode=1696327200029 2023-10-03 10:00:01,144 INFO [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33857,1696327198658 with isa=jenkins-hbase4.apache.org/172.31.14.131:42977, startcode=1696327199993 2023-10-03 10:00:01,163 DEBUG [RS:1;jenkins-hbase4:42977] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-03 10:00:01,163 DEBUG [RS:2;jenkins-hbase4:34139] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-03 10:00:01,163 DEBUG [RS:0;jenkins-hbase4:36133] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-03 10:00:01,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-03 10:00:01,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-03 10:00:01,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-03 10:00:01,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-03 10:00:01,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-03 10:00:01,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-03 10:00:01,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-03 10:00:01,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696327231201 2023-10-03 10:00:01,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-03 10:00:01,208 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-03 10:00:01,208 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-03 10:00:01,213 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-03 10:00:01,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-03 10:00:01,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-03 10:00:01,227 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55553, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-03 10:00:01,227 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51441, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-03 10:00:01,227 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43193, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-03 10:00:01,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-03 10:00:01,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-03 10:00:01,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-03 10:00:01,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-03 10:00:01,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-03 10:00:01,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-03 10:00:01,239 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33857] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-03 10:00:01,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-03 10:00:01,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-03 10:00:01,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696327201244,5,FailOnTimeoutGroup] 2023-10-03 10:00:01,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696327201245,5,FailOnTimeoutGroup] 2023-10-03 10:00:01,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-03 10:00:01,249 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33857] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-03 10:00:01,250 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33857] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-03 10:00:01,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,275 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-03 10:00:01,276 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-03 10:00:01,277 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:01,298 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(2830): Master is not running yet 2023-10-03 10:00:01,298 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(2830): Master is not running yet 2023-10-03 10:00:01,300 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(2830): Master is not running yet 2023-10-03 10:00:01,298 WARN [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-03 10:00:01,300 WARN [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-03 10:00:01,300 WARN [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-03 10:00:01,305 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:01,308 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-03 10:00:01,310 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/info 2023-10-03 10:00:01,310 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-03 10:00:01,311 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:01,312 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-03 10:00:01,314 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/rep_barrier 2023-10-03 10:00:01,314 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-03 10:00:01,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:01,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-03 10:00:01,317 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/table 2023-10-03 10:00:01,318 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-03 10:00:01,319 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:01,320 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740 2023-10-03 10:00:01,321 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740 2023-10-03 10:00:01,324 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-03 10:00:01,327 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-03 10:00:01,331 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:00:01,332 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67072736, jitterRate=-5.383491516113281E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-03 10:00:01,332 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-03 10:00:01,332 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-03 10:00:01,333 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-03 10:00:01,333 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-03 10:00:01,333 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-03 10:00:01,333 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-03 10:00:01,335 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-03 10:00:01,335 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-03 10:00:01,341 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-03 10:00:01,341 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-03 10:00:01,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-03 10:00:01,366 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-03 10:00:01,370 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-03 10:00:01,402 INFO [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33857,1696327198658 with isa=jenkins-hbase4.apache.org/172.31.14.131:34139, startcode=1696327200029 2023-10-03 10:00:01,402 INFO [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33857,1696327198658 with isa=jenkins-hbase4.apache.org/172.31.14.131:36133, startcode=1696327199942 2023-10-03 10:00:01,403 INFO [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33857,1696327198658 with isa=jenkins-hbase4.apache.org/172.31.14.131:42977, startcode=1696327199993 2023-10-03 10:00:01,408 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33857] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:01,413 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33857] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:01,414 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:01,414 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33857] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:01,414 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36071 2023-10-03 10:00:01,414 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-03 10:00:01,415 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:01,415 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36071 2023-10-03 10:00:01,415 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-03 10:00:01,416 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:01,416 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36071 2023-10-03 10:00:01,416 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-03 10:00:01,421 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-03 10:00:01,425 DEBUG [RS:2;jenkins-hbase4:34139] zookeeper.ZKUtil(162): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:01,425 WARN [RS:2;jenkins-hbase4:34139] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-03 10:00:01,425 INFO [RS:2;jenkins-hbase4:34139] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-03 10:00:01,425 DEBUG [RS:0;jenkins-hbase4:36133] zookeeper.ZKUtil(162): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:01,425 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:01,426 DEBUG [RS:1;jenkins-hbase4:42977] zookeeper.ZKUtil(162): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:01,425 WARN [RS:0;jenkins-hbase4:36133] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-03 10:00:01,426 WARN [RS:1;jenkins-hbase4:42977] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-03 10:00:01,426 INFO [RS:0;jenkins-hbase4:36133] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-03 10:00:01,426 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34139,1696327200029] 2023-10-03 10:00:01,427 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:01,427 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36133,1696327199942] 2023-10-03 10:00:01,427 INFO [RS:1;jenkins-hbase4:42977] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-03 10:00:01,427 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:01,427 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42977,1696327199993] 2023-10-03 10:00:01,441 DEBUG [RS:1;jenkins-hbase4:42977] zookeeper.ZKUtil(162): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:01,441 DEBUG [RS:0;jenkins-hbase4:36133] zookeeper.ZKUtil(162): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:01,441 DEBUG [RS:2;jenkins-hbase4:34139] zookeeper.ZKUtil(162): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:01,442 DEBUG [RS:1;jenkins-hbase4:42977] zookeeper.ZKUtil(162): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:01,442 DEBUG [RS:0;jenkins-hbase4:36133] zookeeper.ZKUtil(162): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:01,442 DEBUG [RS:2;jenkins-hbase4:34139] zookeeper.ZKUtil(162): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:01,442 DEBUG [RS:1;jenkins-hbase4:42977] zookeeper.ZKUtil(162): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:01,442 DEBUG [RS:0;jenkins-hbase4:36133] zookeeper.ZKUtil(162): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:01,443 DEBUG [RS:2;jenkins-hbase4:34139] zookeeper.ZKUtil(162): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:01,455 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-03 10:00:01,455 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-03 10:00:01,455 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-03 10:00:01,466 INFO [RS:1;jenkins-hbase4:42977] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-03 10:00:01,466 INFO [RS:0;jenkins-hbase4:36133] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-03 10:00:01,466 INFO [RS:2;jenkins-hbase4:34139] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-03 10:00:01,489 INFO [RS:1;jenkins-hbase4:42977] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-03 10:00:01,489 INFO [RS:2;jenkins-hbase4:34139] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-03 10:00:01,492 INFO [RS:0;jenkins-hbase4:36133] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-03 10:00:01,495 INFO [RS:2;jenkins-hbase4:34139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-03 10:00:01,495 INFO [RS:1;jenkins-hbase4:42977] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-03 10:00:01,495 INFO [RS:2;jenkins-hbase4:34139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,495 INFO [RS:0;jenkins-hbase4:36133] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-03 10:00:01,496 INFO [RS:1;jenkins-hbase4:42977] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,496 INFO [RS:0;jenkins-hbase4:36133] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,497 INFO [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-03 10:00:01,497 INFO [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-03 10:00:01,498 INFO [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-03 10:00:01,506 INFO [RS:0;jenkins-hbase4:36133] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,506 INFO [RS:2;jenkins-hbase4:34139] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,506 INFO [RS:1;jenkins-hbase4:42977] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,506 DEBUG [RS:0;jenkins-hbase4:36133] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,506 DEBUG [RS:2;jenkins-hbase4:34139] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,507 DEBUG [RS:0;jenkins-hbase4:36133] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,507 DEBUG [RS:2;jenkins-hbase4:34139] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,507 DEBUG [RS:0;jenkins-hbase4:36133] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,506 DEBUG [RS:1;jenkins-hbase4:42977] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,507 DEBUG [RS:0;jenkins-hbase4:36133] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,507 DEBUG [RS:1;jenkins-hbase4:42977] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,507 DEBUG [RS:2;jenkins-hbase4:34139] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,507 DEBUG [RS:1;jenkins-hbase4:42977] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,507 DEBUG [RS:0;jenkins-hbase4:36133] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,507 DEBUG [RS:1;jenkins-hbase4:42977] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,507 DEBUG [RS:0;jenkins-hbase4:36133] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-03 10:00:01,507 DEBUG [RS:1;jenkins-hbase4:42977] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:0;jenkins-hbase4:36133] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:1;jenkins-hbase4:42977] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-03 10:00:01,507 DEBUG [RS:2;jenkins-hbase4:34139] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:1;jenkins-hbase4:42977] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:0;jenkins-hbase4:36133] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:1;jenkins-hbase4:42977] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:0;jenkins-hbase4:36133] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:1;jenkins-hbase4:42977] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:0;jenkins-hbase4:36133] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:1;jenkins-hbase4:42977] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:2;jenkins-hbase4:34139] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,508 DEBUG [RS:2;jenkins-hbase4:34139] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-03 10:00:01,509 DEBUG [RS:2;jenkins-hbase4:34139] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,509 DEBUG [RS:2;jenkins-hbase4:34139] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,509 DEBUG [RS:2;jenkins-hbase4:34139] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,509 DEBUG [RS:2;jenkins-hbase4:34139] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-03 10:00:01,514 INFO [RS:2;jenkins-hbase4:34139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,514 INFO [RS:2;jenkins-hbase4:34139] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,514 INFO [RS:2;jenkins-hbase4:34139] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,517 INFO [RS:0;jenkins-hbase4:36133] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,517 INFO [RS:0;jenkins-hbase4:36133] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,517 INFO [RS:0;jenkins-hbase4:36133] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,517 INFO [RS:1;jenkins-hbase4:42977] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,517 INFO [RS:1;jenkins-hbase4:42977] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,517 INFO [RS:1;jenkins-hbase4:42977] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,522 DEBUG [jenkins-hbase4:33857] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-03 10:00:01,527 DEBUG [jenkins-hbase4:33857] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-03 10:00:01,534 DEBUG [jenkins-hbase4:33857] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-03 10:00:01,534 DEBUG [jenkins-hbase4:33857] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-03 10:00:01,534 DEBUG [jenkins-hbase4:33857] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-03 10:00:01,534 DEBUG [jenkins-hbase4:33857] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-03 10:00:01,537 INFO [RS:2;jenkins-hbase4:34139] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-03 10:00:01,537 INFO [RS:0;jenkins-hbase4:36133] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-03 10:00:01,538 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42977,1696327199993, state=OPENING 2023-10-03 10:00:01,539 INFO [RS:1;jenkins-hbase4:42977] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-03 10:00:01,541 INFO [RS:0;jenkins-hbase4:36133] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36133,1696327199942-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,541 INFO [RS:1;jenkins-hbase4:42977] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42977,1696327199993-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,542 INFO [RS:2;jenkins-hbase4:34139] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34139,1696327200029-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:01,548 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-03 10:00:01,550 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:00:01,551 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-03 10:00:01,558 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:00:01,575 INFO [RS:1;jenkins-hbase4:42977] regionserver.Replication(203): jenkins-hbase4.apache.org,42977,1696327199993 started 2023-10-03 10:00:01,576 INFO [RS:2;jenkins-hbase4:34139] regionserver.Replication(203): jenkins-hbase4.apache.org,34139,1696327200029 started 2023-10-03 10:00:01,576 INFO [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42977,1696327199993, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42977, sessionid=0x1010bba1bd60002 2023-10-03 10:00:01,576 INFO [RS:0;jenkins-hbase4:36133] regionserver.Replication(203): jenkins-hbase4.apache.org,36133,1696327199942 started 2023-10-03 10:00:01,576 INFO [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34139,1696327200029, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34139, sessionid=0x1010bba1bd60003 2023-10-03 10:00:01,578 DEBUG [RS:2;jenkins-hbase4:34139] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-03 10:00:01,578 DEBUG [RS:2;jenkins-hbase4:34139] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:01,578 DEBUG [RS:2;jenkins-hbase4:34139] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34139,1696327200029' 2023-10-03 10:00:01,578 DEBUG [RS:2;jenkins-hbase4:34139] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-03 10:00:01,578 DEBUG [RS:1;jenkins-hbase4:42977] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-03 10:00:01,577 INFO [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36133,1696327199942, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36133, sessionid=0x1010bba1bd60001 2023-10-03 10:00:01,579 DEBUG [RS:2;jenkins-hbase4:34139] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-03 10:00:01,581 DEBUG [RS:2;jenkins-hbase4:34139] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-03 10:00:01,581 DEBUG [RS:2;jenkins-hbase4:34139] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-03 10:00:01,582 DEBUG [RS:2;jenkins-hbase4:34139] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:01,582 DEBUG [RS:2;jenkins-hbase4:34139] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34139,1696327200029' 2023-10-03 10:00:01,582 DEBUG [RS:2;jenkins-hbase4:34139] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:01,578 DEBUG [RS:1;jenkins-hbase4:42977] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:01,580 DEBUG [RS:0;jenkins-hbase4:36133] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-03 10:00:01,584 DEBUG [RS:0;jenkins-hbase4:36133] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:01,582 DEBUG [RS:1;jenkins-hbase4:42977] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42977,1696327199993' 2023-10-03 10:00:01,584 DEBUG [RS:1;jenkins-hbase4:42977] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-03 10:00:01,584 DEBUG [RS:0;jenkins-hbase4:36133] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36133,1696327199942' 2023-10-03 10:00:01,584 DEBUG [RS:0;jenkins-hbase4:36133] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-03 10:00:01,584 DEBUG [RS:2;jenkins-hbase4:34139] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:01,585 DEBUG [RS:0;jenkins-hbase4:36133] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-03 10:00:01,585 DEBUG [RS:1;jenkins-hbase4:42977] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-03 10:00:01,585 DEBUG [RS:2;jenkins-hbase4:34139] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-03 10:00:01,585 INFO [RS:2;jenkins-hbase4:34139] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-03 10:00:01,586 INFO [RS:2;jenkins-hbase4:34139] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-03 10:00:01,586 DEBUG [RS:1;jenkins-hbase4:42977] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-03 10:00:01,586 DEBUG [RS:1;jenkins-hbase4:42977] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-03 10:00:01,586 DEBUG [RS:1;jenkins-hbase4:42977] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:01,587 DEBUG [RS:1;jenkins-hbase4:42977] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42977,1696327199993' 2023-10-03 10:00:01,587 DEBUG [RS:1;jenkins-hbase4:42977] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:01,587 DEBUG [RS:0;jenkins-hbase4:36133] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-03 10:00:01,587 DEBUG [RS:0;jenkins-hbase4:36133] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-03 10:00:01,587 DEBUG [RS:0;jenkins-hbase4:36133] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:01,587 DEBUG [RS:0;jenkins-hbase4:36133] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36133,1696327199942' 2023-10-03 10:00:01,587 DEBUG [RS:0;jenkins-hbase4:36133] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:01,588 DEBUG [RS:1;jenkins-hbase4:42977] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:01,588 DEBUG [RS:0;jenkins-hbase4:36133] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:01,588 DEBUG [RS:0;jenkins-hbase4:36133] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-03 10:00:01,589 INFO [RS:0;jenkins-hbase4:36133] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-03 10:00:01,589 DEBUG [RS:1;jenkins-hbase4:42977] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-03 10:00:01,589 INFO [RS:0;jenkins-hbase4:36133] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-03 10:00:01,590 INFO [RS:1;jenkins-hbase4:42977] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-03 10:00:01,590 INFO [RS:1;jenkins-hbase4:42977] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-03 10:00:01,697 INFO [RS:2;jenkins-hbase4:34139] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34139%2C1696327200029, suffix=, logDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,34139,1696327200029, archiveDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/oldWALs, maxLogs=32 2023-10-03 10:00:01,697 INFO [RS:0;jenkins-hbase4:36133] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36133%2C1696327199942, suffix=, logDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,36133,1696327199942, archiveDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/oldWALs, maxLogs=32 2023-10-03 10:00:01,703 INFO [RS:1;jenkins-hbase4:42977] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42977%2C1696327199993, suffix=, logDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,42977,1696327199993, archiveDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/oldWALs, maxLogs=32 2023-10-03 10:00:01,731 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33203,DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c,DISK] 2023-10-03 10:00:01,732 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36859,DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e,DISK] 2023-10-03 10:00:01,732 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13,DISK] 2023-10-03 10:00:01,744 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13,DISK] 2023-10-03 10:00:01,744 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36859,DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e,DISK] 2023-10-03 10:00:01,752 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33203,DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c,DISK] 2023-10-03 10:00:01,760 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33203,DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c,DISK] 2023-10-03 10:00:01,761 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13,DISK] 2023-10-03 10:00:01,762 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36859,DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e,DISK] 2023-10-03 10:00:01,772 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:01,775 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-03 10:00:01,777 INFO [RS:1;jenkins-hbase4:42977] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,42977,1696327199993/jenkins-hbase4.apache.org%2C42977%2C1696327199993.1696327201707 2023-10-03 10:00:01,778 DEBUG [RS:1;jenkins-hbase4:42977] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33203,DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c,DISK], DatanodeInfoWithStorage[127.0.0.1:36859,DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e,DISK], DatanodeInfoWithStorage[127.0.0.1:35435,DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13,DISK]] 2023-10-03 10:00:01,778 INFO [RS:2;jenkins-hbase4:34139] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,34139,1696327200029/jenkins-hbase4.apache.org%2C34139%2C1696327200029.1696327201707 2023-10-03 10:00:01,778 INFO [RS:0;jenkins-hbase4:36133] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,36133,1696327199942/jenkins-hbase4.apache.org%2C36133%2C1696327199942.1696327201707 2023-10-03 10:00:01,779 DEBUG [RS:0;jenkins-hbase4:36133] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36859,DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e,DISK], DatanodeInfoWithStorage[127.0.0.1:35435,DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13,DISK], DatanodeInfoWithStorage[127.0.0.1:33203,DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c,DISK]] 2023-10-03 10:00:01,786 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-03 10:00:01,786 DEBUG [RS:2;jenkins-hbase4:34139] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35435,DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13,DISK], DatanodeInfoWithStorage[127.0.0.1:33203,DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c,DISK], DatanodeInfoWithStorage[127.0.0.1:36859,DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e,DISK]] 2023-10-03 10:00:01,805 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-03 10:00:01,806 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-03 10:00:01,813 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42977%2C1696327199993.meta, suffix=.meta, logDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,42977,1696327199993, archiveDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/oldWALs, maxLogs=32 2023-10-03 10:00:01,834 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33203,DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c,DISK] 2023-10-03 10:00:01,835 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13,DISK] 2023-10-03 10:00:01,838 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36859,DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e,DISK] 2023-10-03 10:00:01,845 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,42977,1696327199993/jenkins-hbase4.apache.org%2C42977%2C1696327199993.meta.1696327201814.meta 2023-10-03 10:00:01,845 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33203,DS-7f41ce61-8b17-4ccf-8d92-bb71c19f4b0c,DISK], DatanodeInfoWithStorage[127.0.0.1:35435,DS-9f21aaa7-25b1-46da-92bb-d4c5204f1d13,DISK], DatanodeInfoWithStorage[127.0.0.1:36859,DS-1176a4eb-650f-4f2f-8a33-2b84ccce859e,DISK]] 2023-10-03 10:00:01,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-03 10:00:01,847 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-03 10:00:01,848 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:01,849 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-03 10:00:01,851 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-03 10:00:01,852 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-03 10:00:01,866 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-03 10:00:01,866 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:01,866 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-03 10:00:01,866 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-03 10:00:01,869 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-03 10:00:01,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/info 2023-10-03 10:00:01,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/info 2023-10-03 10:00:01,872 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-03 10:00:01,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:01,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-03 10:00:01,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/rep_barrier 2023-10-03 10:00:01,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/rep_barrier 2023-10-03 10:00:01,876 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-03 10:00:01,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:01,877 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-03 10:00:01,878 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/table 2023-10-03 10:00:01,878 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/table 2023-10-03 10:00:01,879 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-03 10:00:01,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:01,882 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740 2023-10-03 10:00:01,885 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740 2023-10-03 10:00:01,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-03 10:00:01,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-03 10:00:01,893 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60168000, jitterRate=-0.10342693328857422}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-03 10:00:01,896 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-03 10:00:01,905 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696327201764 2023-10-03 10:00:01,928 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-03 10:00:01,929 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-03 10:00:01,930 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42977,1696327199993, state=OPEN 2023-10-03 10:00:01,933 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-03 10:00:01,933 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-03 10:00:01,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-03 10:00:01,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42977,1696327199993 in 375 msec 2023-10-03 10:00:01,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-03 10:00:01,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 586 msec 2023-10-03 10:00:01,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 844 msec 2023-10-03 10:00:01,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696327201950, completionTime=-1 2023-10-03 10:00:01,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-03 10:00:01,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-03 10:00:02,019 DEBUG [hconnection-0x48161bf2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:02,024 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:02,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-03 10:00:02,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696327262047 2023-10-03 10:00:02,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696327322048 2023-10-03 10:00:02,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 96 msec 2023-10-03 10:00:02,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33857,1696327198658-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:02,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33857,1696327198658-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:02,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33857,1696327198658-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:02,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33857, period=300000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:02,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-03 10:00:02,092 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-03 10:00:02,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-03 10:00:02,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-03 10:00:02,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-03 10:00:02,114 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-03 10:00:02,117 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-03 10:00:02,145 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:00:02,147 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c empty. 2023-10-03 10:00:02,148 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:00:02,148 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-03 10:00:02,191 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-03 10:00:02,193 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e57de513a367d2c9e92fb7aae5f16a5c, NAME => 'hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:00:02,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:02,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e57de513a367d2c9e92fb7aae5f16a5c, disabling compactions & flushes 2023-10-03 10:00:02,218 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:00:02,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:00:02,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. after waiting 0 ms 2023-10-03 10:00:02,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:00:02,218 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:00:02,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e57de513a367d2c9e92fb7aae5f16a5c: 2023-10-03 10:00:02,223 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-03 10:00:02,239 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696327202227"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327202227"}]},"ts":"1696327202227"} 2023-10-03 10:00:02,267 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-03 10:00:02,268 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-03 10:00:02,273 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327202269"}]},"ts":"1696327202269"} 2023-10-03 10:00:02,276 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-03 10:00:02,281 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-03 10:00:02,282 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-03 10:00:02,282 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-03 10:00:02,282 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-03 10:00:02,282 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-03 10:00:02,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e57de513a367d2c9e92fb7aae5f16a5c, ASSIGN}] 2023-10-03 10:00:02,287 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e57de513a367d2c9e92fb7aae5f16a5c, ASSIGN 2023-10-03 10:00:02,289 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e57de513a367d2c9e92fb7aae5f16a5c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36133,1696327199942; forceNewPlan=false, retain=false 2023-10-03 10:00:02,441 INFO [jenkins-hbase4:33857] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-03 10:00:02,442 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e57de513a367d2c9e92fb7aae5f16a5c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:02,442 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696327202442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327202442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327202442"}]},"ts":"1696327202442"} 2023-10-03 10:00:02,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e57de513a367d2c9e92fb7aae5f16a5c, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:00:02,608 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:02,609 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-03 10:00:02,613 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-03 10:00:02,621 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:00:02,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e57de513a367d2c9e92fb7aae5f16a5c, NAME => 'hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c.', STARTKEY => '', ENDKEY => ''} 2023-10-03 10:00:02,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. service=AccessControlService 2023-10-03 10:00:02,624 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:02,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:00:02,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:02,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:00:02,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:00:02,627 INFO [StoreOpener-e57de513a367d2c9e92fb7aae5f16a5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:00:02,629 DEBUG [StoreOpener-e57de513a367d2c9e92fb7aae5f16a5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c/info 2023-10-03 10:00:02,629 DEBUG [StoreOpener-e57de513a367d2c9e92fb7aae5f16a5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c/info 2023-10-03 10:00:02,630 INFO [StoreOpener-e57de513a367d2c9e92fb7aae5f16a5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e57de513a367d2c9e92fb7aae5f16a5c columnFamilyName info 2023-10-03 10:00:02,631 INFO [StoreOpener-e57de513a367d2c9e92fb7aae5f16a5c-1] regionserver.HStore(310): Store=e57de513a367d2c9e92fb7aae5f16a5c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:02,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:00:02,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:00:02,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:00:02,643 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:00:02,643 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e57de513a367d2c9e92fb7aae5f16a5c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59957211, jitterRate=-0.10656793415546417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:00:02,644 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e57de513a367d2c9e92fb7aae5f16a5c: 2023-10-03 10:00:02,646 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c., pid=6, masterSystemTime=1696327202608 2023-10-03 10:00:02,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:00:02,651 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:00:02,653 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e57de513a367d2c9e92fb7aae5f16a5c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:02,653 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696327202652"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327202652"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327202652"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327202652"}]},"ts":"1696327202652"} 2023-10-03 10:00:02,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-03 10:00:02,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e57de513a367d2c9e92fb7aae5f16a5c, server=jenkins-hbase4.apache.org,36133,1696327199942 in 205 msec 2023-10-03 10:00:02,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-03 10:00:02,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e57de513a367d2c9e92fb7aae5f16a5c, ASSIGN in 378 msec 2023-10-03 10:00:02,668 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-03 10:00:02,668 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327202668"}]},"ts":"1696327202668"} 2023-10-03 10:00:02,670 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-03 10:00:02,673 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-03 10:00:02,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 570 msec 2023-10-03 10:00:02,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-03 10:00:02,719 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-03 10:00:02,719 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:00:02,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:02,750 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:02,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-03 10:00:02,783 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-03 10:00:02,788 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-10-03 10:00:02,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-03 10:00:02,811 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-03 10:00:02,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-10-03 10:00:02,826 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-03 10:00:02,830 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-03 10:00:02,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.731sec 2023-10-03 10:00:02,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-03 10:00:02,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-03 10:00:02,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-03 10:00:02,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33857,1696327198658-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-03 10:00:02,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33857,1696327198658-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-03 10:00:02,864 DEBUG [Listener at localhost/46481] zookeeper.ReadOnlyZKClient(139): Connect 0x5d73dc0e to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:02,869 DEBUG [Listener at localhost/46481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e28b15d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:02,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-03 10:00:02,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-03 10:00:02,877 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-03 10:00:02,879 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-03 10:00:02,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-03 10:00:02,883 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:00:02,886 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928 empty. 2023-10-03 10:00:02,889 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:00:02,889 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-03 10:00:02,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-03 10:00:02,897 DEBUG [hconnection-0x6026727-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:02,915 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:02,920 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33857,1696327198658 2023-10-03 10:00:02,920 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-03 10:00:02,920 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/test.cache.data in system properties and HBase conf 2023-10-03 10:00:02,921 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop.tmp.dir in system properties and HBase conf 2023-10-03 10:00:02,921 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop.log.dir in system properties and HBase conf 2023-10-03 10:00:02,921 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-03 10:00:02,921 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-03 10:00:02,921 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-03 10:00:02,921 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-03 10:00:02,922 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-03 10:00:02,922 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-03 10:00:02,922 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-03 10:00:02,922 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-03 10:00:02,922 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-03 10:00:02,922 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-03 10:00:02,922 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-03 10:00:02,922 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-03 10:00:02,923 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-03 10:00:02,923 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/nfs.dump.dir in system properties and HBase conf 2023-10-03 10:00:02,923 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/java.io.tmpdir in system properties and HBase conf 2023-10-03 10:00:02,923 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-03 10:00:02,923 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-03 10:00:02,923 INFO [Listener at localhost/46481] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-03 10:00:02,925 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5cf1c177e5714ffebd72cf3b7a71e928, NAME => 'hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:00:02,953 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:02,954 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 5cf1c177e5714ffebd72cf3b7a71e928, disabling compactions & flushes 2023-10-03 10:00:02,954 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:00:02,954 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:00:02,954 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. after waiting 0 ms 2023-10-03 10:00:02,954 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:00:02,954 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:00:02,954 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 5cf1c177e5714ffebd72cf3b7a71e928: 2023-10-03 10:00:02,960 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-03 10:00:02,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696327202962"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327202962"}]},"ts":"1696327202962"} 2023-10-03 10:00:02,966 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-03 10:00:02,968 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-03 10:00:02,969 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327202968"}]},"ts":"1696327202968"} 2023-10-03 10:00:02,971 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-03 10:00:02,976 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-03 10:00:02,980 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-03 10:00:02,981 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-03 10:00:02,981 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-03 10:00:02,981 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-03 10:00:02,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5cf1c177e5714ffebd72cf3b7a71e928, ASSIGN}] 2023-10-03 10:00:02,988 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5cf1c177e5714ffebd72cf3b7a71e928, ASSIGN 2023-10-03 10:00:02,990 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=5cf1c177e5714ffebd72cf3b7a71e928, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34139,1696327200029; forceNewPlan=false, retain=false 2023-10-03 10:00:02,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-03 10:00:03,141 INFO [jenkins-hbase4:33857] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-03 10:00:03,142 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5cf1c177e5714ffebd72cf3b7a71e928, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:03,143 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696327203142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327203142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327203142"}]},"ts":"1696327203142"} 2023-10-03 10:00:03,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 5cf1c177e5714ffebd72cf3b7a71e928, server=jenkins-hbase4.apache.org,34139,1696327200029}] 2023-10-03 10:00:03,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-03 10:00:03,303 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:03,303 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-03 10:00:03,306 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-03 10:00:03,313 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:00:03,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5cf1c177e5714ffebd72cf3b7a71e928, NAME => 'hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928.', STARTKEY => '', ENDKEY => ''} 2023-10-03 10:00:03,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. service=AccessControlService 2023-10-03 10:00:03,314 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:03,315 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:00:03,315 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:03,315 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:00:03,315 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:00:03,317 INFO [StoreOpener-5cf1c177e5714ffebd72cf3b7a71e928-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:00:03,320 DEBUG [StoreOpener-5cf1c177e5714ffebd72cf3b7a71e928-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928/l 2023-10-03 10:00:03,320 DEBUG [StoreOpener-5cf1c177e5714ffebd72cf3b7a71e928-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928/l 2023-10-03 10:00:03,321 INFO [StoreOpener-5cf1c177e5714ffebd72cf3b7a71e928-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cf1c177e5714ffebd72cf3b7a71e928 columnFamilyName l 2023-10-03 10:00:03,322 INFO [StoreOpener-5cf1c177e5714ffebd72cf3b7a71e928-1] regionserver.HStore(310): Store=5cf1c177e5714ffebd72cf3b7a71e928/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:03,324 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:00:03,326 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:00:03,331 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:00:03,338 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:00:03,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5cf1c177e5714ffebd72cf3b7a71e928; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67969083, jitterRate=0.012818261981010437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:00:03,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5cf1c177e5714ffebd72cf3b7a71e928: 2023-10-03 10:00:03,344 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928., pid=11, masterSystemTime=1696327203303 2023-10-03 10:00:03,349 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:00:03,350 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:00:03,351 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5cf1c177e5714ffebd72cf3b7a71e928, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:03,351 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696327203351"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327203351"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327203351"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327203351"}]},"ts":"1696327203351"} 2023-10-03 10:00:03,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-03 10:00:03,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 5cf1c177e5714ffebd72cf3b7a71e928, server=jenkins-hbase4.apache.org,34139,1696327200029 in 209 msec 2023-10-03 10:00:03,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-03 10:00:03,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=5cf1c177e5714ffebd72cf3b7a71e928, ASSIGN in 380 msec 2023-10-03 10:00:03,367 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-03 10:00:03,367 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327203367"}]},"ts":"1696327203367"} 2023-10-03 10:00:03,369 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-03 10:00:03,374 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-03 10:00:03,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 506 msec 2023-10-03 10:00:03,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-03 10:00:03,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-03 10:00:03,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-03 10:00:04,172 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-03 10:00:04,455 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-10-03 10:00:04,462 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34151_jobhistory____6ihnlh/webapp 2023-10-03 10:00:04,633 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-03 10:00:04,633 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-03 10:00:04,633 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-03 10:00:04,636 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-03 10:00:04,701 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:04,961 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:05,403 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-03 10:00:05,443 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34151 2023-10-03 10:00:05,667 WARN [Listener at jenkins-hbase4.apache.org/38141] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-03 10:00:05,930 WARN [Listener at jenkins-hbase4.apache.org/38141] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-03 10:00:05,931 INFO [Listener at jenkins-hbase4.apache.org/38141] log.Slf4jLog(67): jetty-6.1.26 2023-10-03 10:00:05,937 INFO [Listener at jenkins-hbase4.apache.org/38141] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37779_cluster____5i0n4f/webapp 2023-10-03 10:00:06,004 INFO [Listener at jenkins-hbase4.apache.org/38141] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-03 10:00:06,004 INFO [Listener at jenkins-hbase4.apache.org/38141] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-03 10:00:06,005 INFO [Listener at jenkins-hbase4.apache.org/38141] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-03 10:00:06,005 INFO [Listener at jenkins-hbase4.apache.org/38141] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-03 10:00:06,014 INFO [Listener at jenkins-hbase4.apache.org/38141] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:06,188 INFO [Listener at jenkins-hbase4.apache.org/38141] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:06,264 INFO [Listener at jenkins-hbase4.apache.org/38141] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:06,270 INFO [Listener at jenkins-hbase4.apache.org/38141] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37779 2023-10-03 10:00:06,770 WARN [Listener at jenkins-hbase4.apache.org/40963] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-03 10:00:06,794 WARN [Listener at jenkins-hbase4.apache.org/40963] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-03 10:00:06,794 INFO [Listener at jenkins-hbase4.apache.org/40963] log.Slf4jLog(67): jetty-6.1.26 2023-10-03 10:00:06,801 INFO [Listener at jenkins-hbase4.apache.org/40963] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39075_node____.u9lx3u/webapp 2023-10-03 10:00:06,852 INFO [Listener at jenkins-hbase4.apache.org/40963] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-03 10:00:06,852 INFO [Listener at jenkins-hbase4.apache.org/40963] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-03 10:00:06,852 INFO [Listener at jenkins-hbase4.apache.org/40963] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-03 10:00:06,852 INFO [Listener at jenkins-hbase4.apache.org/40963] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-03 10:00:06,861 INFO [Listener at jenkins-hbase4.apache.org/40963] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:06,915 INFO [Listener at jenkins-hbase4.apache.org/40963] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:06,986 INFO [Listener at jenkins-hbase4.apache.org/40963] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:06,996 INFO [Listener at jenkins-hbase4.apache.org/40963] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39075 2023-10-03 10:00:07,186 WARN [Listener at jenkins-hbase4.apache.org/39739] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-03 10:00:07,194 WARN [Listener at jenkins-hbase4.apache.org/39739] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-03 10:00:07,195 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): jetty-6.1.26 2023-10-03 10:00:07,202 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40583_node____.4bt426/webapp 2023-10-03 10:00:07,277 INFO [Listener at jenkins-hbase4.apache.org/39739] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-03 10:00:07,278 INFO [Listener at jenkins-hbase4.apache.org/39739] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-03 10:00:07,278 INFO [Listener at jenkins-hbase4.apache.org/39739] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-03 10:00:07,278 INFO [Listener at jenkins-hbase4.apache.org/39739] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-03 10:00:07,286 INFO [Listener at jenkins-hbase4.apache.org/39739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:07,297 INFO [Listener at jenkins-hbase4.apache.org/39739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:07,363 INFO [Listener at jenkins-hbase4.apache.org/39739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-03 10:00:07,369 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40583 2023-10-03 10:00:07,398 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-03 10:00:07,399 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:00:07,423 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-03 10:00:07,481 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=168, AvailableMemoryMB=8984 2023-10-03 10:00:07,481 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-10-03 10:00:07,510 DEBUG [Listener at jenkins-hbase4.apache.org/39739] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-03 10:00:07,518 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-03 10:00:07,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-03 10:00:07,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-03 10:00:07,544 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-03 10:00:07,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-03 10:00:07,548 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-03 10:00:07,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-03 10:00:07,554 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:07,555 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c empty. 2023-10-03 10:00:07,556 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:07,557 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:07,559 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a empty. 2023-10-03 10:00:07,560 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:07,560 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-03 10:00:07,619 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-03 10:00:07,627 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 36ff3ceb87e3c818f59aed12621c289c, NAME => 'testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:00:07,627 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 086f1ca7c4bf54e39115a298868aea0a, NAME => 'testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:00:07,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-03 10:00:07,674 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-03 10:00:07,686 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-03 10:00:07,687 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-03 10:00:07,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:07,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 36ff3ceb87e3c818f59aed12621c289c, disabling compactions & flushes 2023-10-03 10:00:07,703 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:07,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:07,704 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. after waiting 0 ms 2023-10-03 10:00:07,704 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:07,704 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:07,704 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 36ff3ceb87e3c818f59aed12621c289c: 2023-10-03 10:00:07,705 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:07,705 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 086f1ca7c4bf54e39115a298868aea0a, disabling compactions & flushes 2023-10-03 10:00:07,705 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:07,705 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:07,705 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. after waiting 0 ms 2023-10-03 10:00:07,705 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:07,705 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:07,705 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 086f1ca7c4bf54e39115a298868aea0a: 2023-10-03 10:00:07,712 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-03 10:00:07,714 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696327207714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327207714"}]},"ts":"1696327207714"} 2023-10-03 10:00:07,714 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696327207714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327207714"}]},"ts":"1696327207714"} 2023-10-03 10:00:07,766 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-03 10:00:07,768 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-03 10:00:07,768 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327207768"}]},"ts":"1696327207768"} 2023-10-03 10:00:07,770 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-03 10:00:07,775 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-03 10:00:07,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-03 10:00:07,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-03 10:00:07,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-03 10:00:07,778 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-03 10:00:07,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36ff3ceb87e3c818f59aed12621c289c, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=086f1ca7c4bf54e39115a298868aea0a, ASSIGN}] 2023-10-03 10:00:07,781 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=086f1ca7c4bf54e39115a298868aea0a, ASSIGN 2023-10-03 10:00:07,781 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36ff3ceb87e3c818f59aed12621c289c, ASSIGN 2023-10-03 10:00:07,782 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36ff3ceb87e3c818f59aed12621c289c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42977,1696327199993; forceNewPlan=false, retain=false 2023-10-03 10:00:07,782 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=086f1ca7c4bf54e39115a298868aea0a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34139,1696327200029; forceNewPlan=false, retain=false 2023-10-03 10:00:07,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-03 10:00:07,933 INFO [jenkins-hbase4:33857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-03 10:00:07,936 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=086f1ca7c4bf54e39115a298868aea0a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:07,936 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=36ff3ceb87e3c818f59aed12621c289c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:07,937 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696327207936"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327207936"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327207936"}]},"ts":"1696327207936"} 2023-10-03 10:00:07,937 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696327207936"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327207936"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327207936"}]},"ts":"1696327207936"} 2023-10-03 10:00:07,939 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 086f1ca7c4bf54e39115a298868aea0a, server=jenkins-hbase4.apache.org,34139,1696327200029}] 2023-10-03 10:00:07,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 36ff3ceb87e3c818f59aed12621c289c, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:00:08,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:08,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 086f1ca7c4bf54e39115a298868aea0a, NAME => 'testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.', STARTKEY => '1', ENDKEY => ''} 2023-10-03 10:00:08,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. service=AccessControlService 2023-10-03 10:00:08,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:08,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:08,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:08,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 36ff3ceb87e3c818f59aed12621c289c, NAME => 'testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.', STARTKEY => '', ENDKEY => '1'} 2023-10-03 10:00:08,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:08,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:08,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:08,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. service=AccessControlService 2023-10-03 10:00:08,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:08,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:08,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:08,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:08,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:08,105 INFO [StoreOpener-086f1ca7c4bf54e39115a298868aea0a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:08,105 INFO [StoreOpener-36ff3ceb87e3c818f59aed12621c289c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:08,108 DEBUG [StoreOpener-36ff3ceb87e3c818f59aed12621c289c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/cf 2023-10-03 10:00:08,108 DEBUG [StoreOpener-36ff3ceb87e3c818f59aed12621c289c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/cf 2023-10-03 10:00:08,109 DEBUG [StoreOpener-086f1ca7c4bf54e39115a298868aea0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/cf 2023-10-03 10:00:08,109 DEBUG [StoreOpener-086f1ca7c4bf54e39115a298868aea0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/cf 2023-10-03 10:00:08,112 INFO [StoreOpener-36ff3ceb87e3c818f59aed12621c289c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36ff3ceb87e3c818f59aed12621c289c columnFamilyName cf 2023-10-03 10:00:08,112 INFO [StoreOpener-086f1ca7c4bf54e39115a298868aea0a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 086f1ca7c4bf54e39115a298868aea0a columnFamilyName cf 2023-10-03 10:00:08,118 INFO [StoreOpener-36ff3ceb87e3c818f59aed12621c289c-1] regionserver.HStore(310): Store=36ff3ceb87e3c818f59aed12621c289c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:08,120 INFO [StoreOpener-086f1ca7c4bf54e39115a298868aea0a-1] regionserver.HStore(310): Store=086f1ca7c4bf54e39115a298868aea0a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:08,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:08,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:08,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:08,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:08,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:08,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:08,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:00:08,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 36ff3ceb87e3c818f59aed12621c289c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64796989, jitterRate=-0.03444962203502655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:00:08,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:00:08,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 36ff3ceb87e3c818f59aed12621c289c: 2023-10-03 10:00:08,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 086f1ca7c4bf54e39115a298868aea0a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68600379, jitterRate=0.022225305438041687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:00:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 086f1ca7c4bf54e39115a298868aea0a: 2023-10-03 10:00:08,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c., pid=16, masterSystemTime=1696327208095 2023-10-03 10:00:08,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-03 10:00:08,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a., pid=15, masterSystemTime=1696327208092 2023-10-03 10:00:08,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:08,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:08,166 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=36ff3ceb87e3c818f59aed12621c289c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:08,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:08,167 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=086f1ca7c4bf54e39115a298868aea0a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,166 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696327208165"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327208165"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327208165"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327208165"}]},"ts":"1696327208165"} 2023-10-03 10:00:08,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:08,167 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696327208167"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327208167"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327208167"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327208167"}]},"ts":"1696327208167"} 2023-10-03 10:00:08,175 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-03 10:00:08,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 36ff3ceb87e3c818f59aed12621c289c, server=jenkins-hbase4.apache.org,42977,1696327199993 in 230 msec 2023-10-03 10:00:08,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-03 10:00:08,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 086f1ca7c4bf54e39115a298868aea0a, server=jenkins-hbase4.apache.org,34139,1696327200029 in 234 msec 2023-10-03 10:00:08,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36ff3ceb87e3c818f59aed12621c289c, ASSIGN in 398 msec 2023-10-03 10:00:08,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-03 10:00:08,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=086f1ca7c4bf54e39115a298868aea0a, ASSIGN in 401 msec 2023-10-03 10:00:08,185 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-03 10:00:08,186 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327208185"}]},"ts":"1696327208185"} 2023-10-03 10:00:08,188 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-03 10:00:08,191 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-03 10:00:08,198 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-03 10:00:08,205 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:08,209 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:08,213 DEBUG [hconnection-0x1655ea17-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:08,217 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-10-03 10:00:08,228 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-03 10:00:08,272 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:08,272 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:08,273 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:00:08,273 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:08,272 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:08,281 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-03 10:00:08,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:08,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:08,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:08,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:08,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 754 msec 2023-10-03 10:00:08,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-03 10:00:08,665 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-03 10:00:08,669 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-03 10:00:08,670 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:08,672 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:00:08,698 DEBUG [hconnection-0x6026727-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:08,704 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:08,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-03 10:00:08,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327208722 (current time:1696327208722). 2023-10-03 10:00:08,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:00:08,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x709f7001 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:08,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4794ddfc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:08,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:08,736 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:08,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x709f7001 to 127.0.0.1:56716 2023-10-03 10:00:08,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:08,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x63c22fb2 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:08,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ebc4e85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:08,748 DEBUG [hconnection-0x5041356f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:08,749 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:08,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:08,758 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:08,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63c22fb2 to 127.0.0.1:56716 2023-10-03 10:00:08,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:08,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-03 10:00:08,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:00:08,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-03 10:00:08,808 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:00:08,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-03 10:00:08,830 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-03 10:00:08,830 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:00:08,831 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-03 10:00:08,831 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:00:08,831 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-03 10:00:08,831 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696327808831 2023-10-03 10:00:08,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-03 10:00:08,832 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-03 10:00:08,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-03 10:00:08,832 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-03 10:00:08,834 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:00:08,834 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-03 10:00:08,834 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-03 10:00:08,834 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-03 10:00:08,836 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-03 10:00:08,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-03 10:00:08,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-10-03 10:00:08,840 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-03 10:00:08,841 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:00:08,841 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:00:08,841 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696327808841 2023-10-03 10:00:08,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,875 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-03 10:00:08,876 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:08,876 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-03 10:00:08,877 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-03 10:00:08,877 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,877 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,885 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:08,885 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:08,885 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:08,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:08,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:08,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:08,885 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,886 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,886 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:08,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,887 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:08,887 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:00:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-03 10:00:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-03 10:00:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-03 10:00:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-03 10:00:08,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-03 10:00:08,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-03 10:00:08,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,896 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-03 10:00:08,896 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-03 10:00:08,896 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-03 10:00:08,896 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:08,896 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:08,896 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:08,898 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-03 10:00:08,897 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-03 10:00:08,899 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-03 10:00:08,899 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-03 10:00:08,899 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-03 10:00:08,899 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-03 10:00:08,899 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-03 10:00:08,899 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-03 10:00:08,899 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-03 10:00:08,902 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,903 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:08,903 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,903 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:08,903 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:08,903 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,903 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:08,904 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,904 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:08,904 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:08,904 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:08,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:08,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:08,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-03 10:00:08,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44f4d93b[Count = 1] remaining members to acquire global barrier 2023-10-03 10:00:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:08,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:08,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:08,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:08,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:08,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-03 10:00:08,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44f4d93b[Count = 0] remaining members to acquire global barrier 2023-10-03 10:00:08,911 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-03 10:00:08,911 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,914 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,914 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,914 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,915 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-03 10:00:08,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,915 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-03 10:00:08,915 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-03 10:00:08,915 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:00:08,915 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:08,916 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,916 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:00:08,916 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:08,916 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:08,916 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:08,917 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-03 10:00:08,917 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. started... 2023-10-03 10:00:08,930 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:08,930 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:08,930 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:08,930 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. started... 2023-10-03 10:00:08,930 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-03 10:00:08,930 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:08,930 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-03 10:00:08,933 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 086f1ca7c4bf54e39115a298868aea0a: 2023-10-03 10:00:08,933 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 36ff3ceb87e3c818f59aed12621c289c: 2023-10-03 10:00:08,934 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,934 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:08,940 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:08,940 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:08,942 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:08,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-03 10:00:08,947 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:00:08,947 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:00:08,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:00:08,948 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:00:08,994 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. completed. 2023-10-03 10:00:08,994 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. completed. 2023-10-03 10:00:08,994 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:08,994 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-03 10:00:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:00:08,995 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:08,996 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-03 10:00:08,996 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:00:08,998 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,998 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-03 10:00:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:08,998 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:08,998 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-03 10:00:08,999 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-03 10:00:08,999 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:08,999 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:08,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:08,999 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-03 10:00:09,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:09,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:09,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34139,1696327200029': 2023-10-03 10:00:09,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-03 10:00:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:09,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:09,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:09,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42977,1696327199993': 2023-10-03 10:00:09,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-03 10:00:09,010 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-03 10:00:09,010 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:00:09,011 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:00:09,011 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,011 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:00:09,014 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,014 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,014 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,014 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,014 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,015 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:09,014 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,015 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:09,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,016 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,017 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:09,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,019 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:09,019 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,020 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:09,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:09,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:09,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:09,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:09,033 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:09,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:09,034 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-03 10:00:09,033 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,033 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:00:09,034 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:09,033 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,034 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,034 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,035 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,035 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,035 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,035 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-03 10:00:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,114 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-03 10:00:09,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,115 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:09,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696327208832Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696327209053 (+221 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696327209053Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696327209053Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696327209071 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696327209100 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696327209114 (+14 ms) 2023-10-03 10:00:09,118 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-03 10:00:09,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 284 msec 2023-10-03 10:00:09,148 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:09,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-03 10:00:09,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:00:09,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42977] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:00:09,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34139] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:00:09,172 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-03 10:00:09,172 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:09,172 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:00:09,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-03 10:00:09,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327209187 (current time:1696327209187). 2023-10-03 10:00:09,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:00:09,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x1af9f11c to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:09,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@174efd15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:09,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:09,199 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:09,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1af9f11c to 127.0.0.1:56716 2023-10-03 10:00:09,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:09,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x7dfa71b5 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:09,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@285e0e07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:09,209 DEBUG [hconnection-0x4818f84c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:09,212 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:09,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:09,216 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:09,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dfa71b5 to 127.0.0.1:56716 2023-10-03 10:00:09,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:09,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-03 10:00:09,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:00:09,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-03 10:00:09,222 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:00:09,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-03 10:00:09,225 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-03 10:00:09,226 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696327809226 2023-10-03 10:00:09,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-03 10:00:09,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-03 10:00:09,228 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:00:09,228 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:00:09,229 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-03 10:00:09,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-03 10:00:09,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-03 10:00:09,231 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-03 10:00:09,232 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696327809232 2023-10-03 10:00:09,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-03 10:00:09,253 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-03 10:00:09,253 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:09,254 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-03 10:00:09,254 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-03 10:00:09,254 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,254 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,256 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:09,256 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:09,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:09,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:09,256 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:09,256 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:09,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,257 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,257 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,258 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,258 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:00:09,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-03 10:00:09,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-03 10:00:09,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,258 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-03 10:00:09,258 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-03 10:00:09,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-03 10:00:09,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-03 10:00:09,259 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-03 10:00:09,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-03 10:00:09,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,259 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:09,259 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-03 10:00:09,260 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-03 10:00:09,260 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:09,259 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-03 10:00:09,261 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-03 10:00:09,261 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-03 10:00:09,261 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-03 10:00:09,260 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-03 10:00:09,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-03 10:00:09,261 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-03 10:00:09,264 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-03 10:00:09,264 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:09,265 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-03 10:00:09,265 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-03 10:00:09,265 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-03 10:00:09,267 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,267 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:09,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:09,269 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,269 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,269 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,269 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:09,269 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:09,269 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,270 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:09,270 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,270 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:09,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:09,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-03 10:00:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:09,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-03 10:00:09,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d2b9511[Count = 1] remaining members to acquire global barrier 2023-10-03 10:00:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:09,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:09,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-03 10:00:09,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:09,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-03 10:00:09,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d2b9511[Count = 0] remaining members to acquire global barrier 2023-10-03 10:00:09,276 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-03 10:00:09,276 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,279 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,279 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,279 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,280 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-03 10:00:09,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,280 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,280 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-03 10:00:09,280 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-03 10:00:09,280 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:00:09,280 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-03 10:00:09,280 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,280 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:09,280 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:09,280 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:00:09,281 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. started... 2023-10-03 10:00:09,281 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:09,280 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:09,281 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. started... 2023-10-03 10:00:09,280 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:09,281 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 36ff3ceb87e3c818f59aed12621c289c 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-03 10:00:09,281 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:09,281 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 086f1ca7c4bf54e39115a298868aea0a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-03 10:00:09,283 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-03 10:00:09,283 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:09,283 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-03 10:00:09,328 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:09,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-03 10:00:09,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:00:09,330 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:00:09,430 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231003ec29536daf4149eba98bedc249da2cd4 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231003ec29536daf4149eba98bedc249da2cd4 2023-10-03 10:00:09,430 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231003da7bda56eedd4452b3c98f98c16724aa to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231003da7bda56eedd4452b3c98f98c16724aa 2023-10-03 10:00:09,469 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/.tmp/cf/488f5128f30c4fd683350e5470a97a79 2023-10-03 10:00:09,471 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/.tmp/cf/f43795aadfb842518d824fef2bf160e5 2023-10-03 10:00:09,481 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/.tmp/cf/488f5128f30c4fd683350e5470a97a79 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/cf/488f5128f30c4fd683350e5470a97a79 2023-10-03 10:00:09,482 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/.tmp/cf/f43795aadfb842518d824fef2bf160e5 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/cf/f43795aadfb842518d824fef2bf160e5 2023-10-03 10:00:09,490 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/cf/488f5128f30c4fd683350e5470a97a79, entries=2, sequenceid=6, filesize=5.2 K 2023-10-03 10:00:09,491 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/cf/f43795aadfb842518d824fef2bf160e5, entries=48, sequenceid=6, filesize=13.0 K 2023-10-03 10:00:09,495 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 086f1ca7c4bf54e39115a298868aea0a in 214ms, sequenceid=6, compaction requested=false 2023-10-03 10:00:09,495 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 36ff3ceb87e3c818f59aed12621c289c in 214ms, sequenceid=6, compaction requested=false 2023-10-03 10:00:09,495 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-03 10:00:09,495 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-03 10:00:09,498 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 36ff3ceb87e3c818f59aed12621c289c: 2023-10-03 10:00:09,498 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 086f1ca7c4bf54e39115a298868aea0a: 2023-10-03 10:00:09,498 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-03 10:00:09,498 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-03 10:00:09,498 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:09,498 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:09,499 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/cf/f43795aadfb842518d824fef2bf160e5] hfiles 2023-10-03 10:00:09,499 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/cf/488f5128f30c4fd683350e5470a97a79] hfiles 2023-10-03 10:00:09,499 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/cf/f43795aadfb842518d824fef2bf160e5 for snapshot=snaptb0-testExportWithTargetName 2023-10-03 10:00:09,499 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/cf/488f5128f30c4fd683350e5470a97a79 for snapshot=snaptb0-testExportWithTargetName 2023-10-03 10:00:09,531 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:09,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-03 10:00:09,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:00:09,532 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-03 10:00:09,832 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:09,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-03 10:00:09,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:00:09,834 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-03 10:00:09,927 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. completed. 2023-10-03 10:00:09,927 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:09,927 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. completed. 2023-10-03 10:00:09,927 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-03 10:00:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:00:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-03 10:00:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:00:09,929 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,929 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-03 10:00:09,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,929 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:09,929 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,929 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-03 10:00:09,929 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-03 10:00:09,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:09,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:09,931 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:09,931 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-03 10:00:09,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:09,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:09,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-03 10:00:09,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:09,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-03 10:00:09,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42977,1696327199993': 2023-10-03 10:00:09,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-03 10:00:09,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:09,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:09,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:09,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:09,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-03 10:00:09,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:09,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-03 10:00:09,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34139,1696327200029': 2023-10-03 10:00:09,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-03 10:00:09,942 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-03 10:00:09,942 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:00:09,942 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:00:09,942 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-03 10:00:09,942 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:00:09,945 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,945 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:09,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:09,945 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,945 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,945 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,946 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,946 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,946 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:09,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,947 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-03 10:00:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,947 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:09,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-03 10:00:09,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:09,954 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-03 10:00:09,954 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,954 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,964 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,964 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:09,965 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:09,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:09,965 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:09,965 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,965 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,965 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,966 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:09,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-03 10:00:09,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:09,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:09,965 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:09,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-03 10:00:09,966 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:09,966 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:09,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:09,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-03 10:00:09,966 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:00:09,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,966 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:09,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,967 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:09,967 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:09,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,967 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:09,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:09,967 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,967 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-03 10:00:09,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231003ec29536daf4149eba98bedc249da2cd4, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231003da7bda56eedd4452b3c98f98c16724aa] mob files 2023-10-03 10:00:09,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231003ec29536daf4149eba98bedc249da2cd4 2023-10-03 10:00:09,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231003da7bda56eedd4452b3c98f98c16724aa 2023-10-03 10:00:09,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-03 10:00:09,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-03 10:00:10,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-03 10:00:10,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-03 10:00:10,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-03 10:00:10,030 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-03 10:00:10,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696327209227Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696327209992 (+765 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696327209992Loading Region manifests for snaptb0-testExportWithTargetName at 1696327209993 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1696327209998 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696327210017 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696327210029 (+12 ms) 2023-10-03 10:00:10,032 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-03 10:00:10,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 806 msec 2023-10-03 10:00:10,335 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:10,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-03 10:00:10,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:00:10,338 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327210338 2023-10-03 10:00:10,338 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36071, tgtDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327210338, rawTgtDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327210338, srcFsUri=hdfs://localhost:36071, srcDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:10,377 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:10,378 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1422423146_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327210338, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327210338/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-03 10:00:10,378 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead, snapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-03 10:00:10,400 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327210338/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-03 10:00:10,470 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,471 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,471 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,472 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,472 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,473 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,473 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,568 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop-8538454566071401916.jar 2023-10-03 10:00:10,568 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,569 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,569 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,570 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,570 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,570 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:10,571 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-03 10:00:10,571 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-03 10:00:10,572 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-03 10:00:10,572 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-03 10:00:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-03 10:00:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-03 10:00:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-03 10:00:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-03 10:00:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-03 10:00:10,575 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-03 10:00:10,578 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:10,579 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:10,579 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:10,579 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:10,580 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:10,580 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:10,581 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:11,313 WARN [Listener at jenkins-hbase4.apache.org/39739] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-03 10:00:11,319 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-03 10:00:11,327 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-03 10:00:11,776 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:00:11,778 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:00:12,247 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0001_000001 (auth:SIMPLE) 2023-10-03 10:00:13,606 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-03 10:00:16,463 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0001_000001 (auth:SIMPLE) 2023-10-03 10:00:18,712 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0001_000001 (auth:SIMPLE) 2023-10-03 10:00:21,456 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0001_000001 (auth:SIMPLE) 2023-10-03 10:00:23,157 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-03 10:00:23,161 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-03 10:00:23,171 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-03 10:00:23,171 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-03 10:00:23,172 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-03 10:00:23,172 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-03 10:00:23,173 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-03 10:00:23,173 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-03 10:00:23,173 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327210338/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327210338/.hbase-snapshot/testExportWithTargetName 2023-10-03 10:00:23,173 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327210338/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-03 10:00:23,173 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327210338/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-03 10:00:23,184 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-03 10:00:23,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-03 10:00:23,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-03 10:00:23,202 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327223202"}]},"ts":"1696327223202"} 2023-10-03 10:00:23,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-03 10:00:23,204 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-03 10:00:23,206 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-03 10:00:23,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36ff3ceb87e3c818f59aed12621c289c, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=086f1ca7c4bf54e39115a298868aea0a, UNASSIGN}] 2023-10-03 10:00:23,210 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36ff3ceb87e3c818f59aed12621c289c, UNASSIGN 2023-10-03 10:00:23,211 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=086f1ca7c4bf54e39115a298868aea0a, UNASSIGN 2023-10-03 10:00:23,212 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=36ff3ceb87e3c818f59aed12621c289c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:23,212 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=086f1ca7c4bf54e39115a298868aea0a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:23,212 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696327223212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327223212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327223212"}]},"ts":"1696327223212"} 2023-10-03 10:00:23,212 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696327223212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327223212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327223212"}]},"ts":"1696327223212"} 2023-10-03 10:00:23,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 086f1ca7c4bf54e39115a298868aea0a, server=jenkins-hbase4.apache.org,34139,1696327200029}] 2023-10-03 10:00:23,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 36ff3ceb87e3c818f59aed12621c289c, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:00:23,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-03 10:00:23,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:23,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:23,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 36ff3ceb87e3c818f59aed12621c289c, disabling compactions & flushes 2023-10-03 10:00:23,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 086f1ca7c4bf54e39115a298868aea0a, disabling compactions & flushes 2023-10-03 10:00:23,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:23,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:23,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:23,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:23,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. after waiting 0 ms 2023-10-03 10:00:23,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. after waiting 0 ms 2023-10-03 10:00:23,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:23,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:23,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:00:23,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:00:23,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:00:23,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:00:23,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a. 2023-10-03 10:00:23,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c. 2023-10-03 10:00:23,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 086f1ca7c4bf54e39115a298868aea0a: 2023-10-03 10:00:23,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 36ff3ceb87e3c818f59aed12621c289c: 2023-10-03 10:00:23,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:23,394 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=36ff3ceb87e3c818f59aed12621c289c, regionState=CLOSED 2023-10-03 10:00:23,395 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696327223394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327223394"}]},"ts":"1696327223394"} 2023-10-03 10:00:23,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:23,396 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=086f1ca7c4bf54e39115a298868aea0a, regionState=CLOSED 2023-10-03 10:00:23,396 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696327223396"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327223396"}]},"ts":"1696327223396"} 2023-10-03 10:00:23,401 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-10-03 10:00:23,401 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 36ff3ceb87e3c818f59aed12621c289c, server=jenkins-hbase4.apache.org,42977,1696327199993 in 183 msec 2023-10-03 10:00:23,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-03 10:00:23,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 086f1ca7c4bf54e39115a298868aea0a, server=jenkins-hbase4.apache.org,34139,1696327200029 in 185 msec 2023-10-03 10:00:23,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36ff3ceb87e3c818f59aed12621c289c, UNASSIGN in 193 msec 2023-10-03 10:00:23,406 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-03 10:00:23,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=086f1ca7c4bf54e39115a298868aea0a, UNASSIGN in 194 msec 2023-10-03 10:00:23,408 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327223407"}]},"ts":"1696327223407"} 2023-10-03 10:00:23,409 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-03 10:00:23,412 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-03 10:00:23,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-10-03 10:00:23,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-03 10:00:23,506 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-03 10:00:23,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-03 10:00:23,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-03 10:00:23,521 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-03 10:00:23,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-03 10:00:23,523 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-03 10:00:23,526 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-03 10:00:23,529 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-03 10:00:23,529 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-03 10:00:23,529 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-03 10:00:23,529 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-03 10:00:23,529 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-03 10:00:23,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-03 10:00:23,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-03 10:00:23,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-03 10:00:23,530 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:23,530 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:23,531 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-03 10:00:23,531 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-03 10:00:23,531 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-03 10:00:23,531 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:23,531 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-03 10:00:23,531 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:23,531 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:23,532 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:23,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-03 10:00:23,534 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/recovered.edits] 2023-10-03 10:00:23,534 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/recovered.edits] 2023-10-03 10:00:23,542 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/cf/f43795aadfb842518d824fef2bf160e5 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/cf/f43795aadfb842518d824fef2bf160e5 2023-10-03 10:00:23,542 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/cf/488f5128f30c4fd683350e5470a97a79 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/cf/488f5128f30c4fd683350e5470a97a79 2023-10-03 10:00:23,547 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a/recovered.edits/9.seqid 2023-10-03 10:00:23,547 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c/recovered.edits/9.seqid 2023-10-03 10:00:23,547 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/086f1ca7c4bf54e39115a298868aea0a 2023-10-03 10:00:23,547 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportWithTargetName/36ff3ceb87e3c818f59aed12621c289c 2023-10-03 10:00:23,547 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-03 10:00:23,548 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-03 10:00:23,549 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-03 10:00:23,553 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231003ec29536daf4149eba98bedc249da2cd4 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231003ec29536daf4149eba98bedc249da2cd4 2023-10-03 10:00:23,555 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231003da7bda56eedd4452b3c98f98c16724aa to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231003da7bda56eedd4452b3c98f98c16724aa 2023-10-03 10:00:23,556 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-03 10:00:23,558 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-03 10:00:23,586 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-03 10:00:23,588 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-03 10:00:23,590 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-03 10:00:23,590 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-03 10:00:23,590 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327223590"}]},"ts":"9223372036854775807"} 2023-10-03 10:00:23,591 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327223590"}]},"ts":"9223372036854775807"} 2023-10-03 10:00:23,593 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-03 10:00:23,593 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 36ff3ceb87e3c818f59aed12621c289c, NAME => 'testtb-testExportWithTargetName,,1696327207526.36ff3ceb87e3c818f59aed12621c289c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 086f1ca7c4bf54e39115a298868aea0a, NAME => 'testtb-testExportWithTargetName,1,1696327207526.086f1ca7c4bf54e39115a298868aea0a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-03 10:00:23,593 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-03 10:00:23,593 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696327223593"}]},"ts":"9223372036854775807"} 2023-10-03 10:00:23,595 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-03 10:00:23,599 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-03 10:00:23,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 87 msec 2023-10-03 10:00:23,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-03 10:00:23,637 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-03 10:00:23,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-03 10:00:23,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-03 10:00:23,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-03 10:00:23,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-03 10:00:23,691 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 706) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-630051649_1 at /127.0.0.1:53558 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-630051649_1 at /127.0.0.1:37268 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:40963 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:37294 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:39626 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:42561 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:43153 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:53588 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=327 (was 308) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=8295 (was 8984) 2023-10-03 10:00:23,691 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-03 10:00:23,711 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=327, ProcessCount=168, AvailableMemoryMB=8294 2023-10-03 10:00:23,711 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-03 10:00:23,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-03 10:00:23,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-03 10:00:23,718 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-03 10:00:23,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-03 10:00:23,720 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-03 10:00:23,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-03 10:00:23,723 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:23,723 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:23,724 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75 empty. 2023-10-03 10:00:23,724 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772 empty. 2023-10-03 10:00:23,724 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:23,725 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:23,725 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-03 10:00:23,738 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-03 10:00:23,739 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9574329802e8cf923e51d19e7e7b3d75, NAME => 'testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:00:23,739 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1eddb877635820bbde9ff1b2b8069772, NAME => 'testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:00:23,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:23,763 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:23,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9574329802e8cf923e51d19e7e7b3d75, disabling compactions & flushes 2023-10-03 10:00:23,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1eddb877635820bbde9ff1b2b8069772, disabling compactions & flushes 2023-10-03 10:00:23,765 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:23,765 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:23,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:23,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:23,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. after waiting 0 ms 2023-10-03 10:00:23,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. after waiting 0 ms 2023-10-03 10:00:23,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:23,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:23,765 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:23,765 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:23,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1eddb877635820bbde9ff1b2b8069772: 2023-10-03 10:00:23,765 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9574329802e8cf923e51d19e7e7b3d75: 2023-10-03 10:00:23,768 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-03 10:00:23,770 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696327223769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327223769"}]},"ts":"1696327223769"} 2023-10-03 10:00:23,770 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696327223769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327223769"}]},"ts":"1696327223769"} 2023-10-03 10:00:23,772 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-03 10:00:23,776 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-03 10:00:23,776 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327223776"}]},"ts":"1696327223776"} 2023-10-03 10:00:23,778 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-03 10:00:23,781 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-03 10:00:23,782 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-03 10:00:23,782 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-03 10:00:23,782 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-03 10:00:23,782 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-03 10:00:23,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9574329802e8cf923e51d19e7e7b3d75, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1eddb877635820bbde9ff1b2b8069772, ASSIGN}] 2023-10-03 10:00:23,785 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1eddb877635820bbde9ff1b2b8069772, ASSIGN 2023-10-03 10:00:23,785 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9574329802e8cf923e51d19e7e7b3d75, ASSIGN 2023-10-03 10:00:23,786 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1eddb877635820bbde9ff1b2b8069772, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42977,1696327199993; forceNewPlan=false, retain=false 2023-10-03 10:00:23,786 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9574329802e8cf923e51d19e7e7b3d75, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34139,1696327200029; forceNewPlan=false, retain=false 2023-10-03 10:00:23,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-03 10:00:23,937 INFO [jenkins-hbase4:33857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-03 10:00:23,940 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9574329802e8cf923e51d19e7e7b3d75, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:23,940 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=1eddb877635820bbde9ff1b2b8069772, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:23,940 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696327223940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327223940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327223940"}]},"ts":"1696327223940"} 2023-10-03 10:00:23,940 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696327223940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327223940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327223940"}]},"ts":"1696327223940"} 2023-10-03 10:00:23,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 9574329802e8cf923e51d19e7e7b3d75, server=jenkins-hbase4.apache.org,34139,1696327200029}] 2023-10-03 10:00:23,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 1eddb877635820bbde9ff1b2b8069772, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:00:24,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-03 10:00:24,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:24,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9574329802e8cf923e51d19e7e7b3d75, NAME => 'testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.', STARTKEY => '', ENDKEY => '1'} 2023-10-03 10:00:24,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. service=AccessControlService 2023-10-03 10:00:24,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:24,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:24,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:24,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:24,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1eddb877635820bbde9ff1b2b8069772, NAME => 'testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.', STARTKEY => '1', ENDKEY => ''} 2023-10-03 10:00:24,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:24,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:24,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. service=AccessControlService 2023-10-03 10:00:24,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:24,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:24,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:24,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:24,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:24,102 INFO [StoreOpener-9574329802e8cf923e51d19e7e7b3d75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:24,102 INFO [StoreOpener-1eddb877635820bbde9ff1b2b8069772-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:24,104 DEBUG [StoreOpener-9574329802e8cf923e51d19e7e7b3d75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/cf 2023-10-03 10:00:24,104 DEBUG [StoreOpener-9574329802e8cf923e51d19e7e7b3d75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/cf 2023-10-03 10:00:24,104 INFO [StoreOpener-9574329802e8cf923e51d19e7e7b3d75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9574329802e8cf923e51d19e7e7b3d75 columnFamilyName cf 2023-10-03 10:00:24,105 DEBUG [StoreOpener-1eddb877635820bbde9ff1b2b8069772-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/cf 2023-10-03 10:00:24,105 DEBUG [StoreOpener-1eddb877635820bbde9ff1b2b8069772-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/cf 2023-10-03 10:00:24,105 INFO [StoreOpener-1eddb877635820bbde9ff1b2b8069772-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1eddb877635820bbde9ff1b2b8069772 columnFamilyName cf 2023-10-03 10:00:24,106 INFO [StoreOpener-9574329802e8cf923e51d19e7e7b3d75-1] regionserver.HStore(310): Store=9574329802e8cf923e51d19e7e7b3d75/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:24,108 INFO [StoreOpener-1eddb877635820bbde9ff1b2b8069772-1] regionserver.HStore(310): Store=1eddb877635820bbde9ff1b2b8069772/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:24,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:24,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:24,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:24,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:24,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:24,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:24,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:00:24,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:00:24,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1eddb877635820bbde9ff1b2b8069772; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61507711, jitterRate=-0.08346368372440338}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:00:24,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1eddb877635820bbde9ff1b2b8069772: 2023-10-03 10:00:24,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9574329802e8cf923e51d19e7e7b3d75; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59970615, jitterRate=-0.10636819899082184}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:00:24,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9574329802e8cf923e51d19e7e7b3d75: 2023-10-03 10:00:24,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772., pid=31, masterSystemTime=1696327224097 2023-10-03 10:00:24,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75., pid=30, masterSystemTime=1696327224095 2023-10-03 10:00:24,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:24,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:24,122 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9574329802e8cf923e51d19e7e7b3d75, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:24,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:24,123 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696327224122"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327224122"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327224122"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327224122"}]},"ts":"1696327224122"} 2023-10-03 10:00:24,124 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=1eddb877635820bbde9ff1b2b8069772, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,124 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696327224123"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327224123"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327224123"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327224123"}]},"ts":"1696327224123"} 2023-10-03 10:00:24,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-03 10:00:24,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 9574329802e8cf923e51d19e7e7b3d75, server=jenkins-hbase4.apache.org,34139,1696327200029 in 183 msec 2023-10-03 10:00:24,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-03 10:00:24,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 1eddb877635820bbde9ff1b2b8069772, server=jenkins-hbase4.apache.org,42977,1696327199993 in 183 msec 2023-10-03 10:00:24,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9574329802e8cf923e51d19e7e7b3d75, ASSIGN in 348 msec 2023-10-03 10:00:24,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-03 10:00:24,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1eddb877635820bbde9ff1b2b8069772, ASSIGN in 353 msec 2023-10-03 10:00:24,138 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-03 10:00:24,138 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327224138"}]},"ts":"1696327224138"} 2023-10-03 10:00:24,140 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-03 10:00:24,142 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-03 10:00:24,143 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-03 10:00:24,145 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-03 10:00:24,147 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:24,147 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:24,147 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:24,147 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:24,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:24,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:24,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:24,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:24,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 434 msec 2023-10-03 10:00:24,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-03 10:00:24,325 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-03 10:00:24,328 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-03 10:00:24,328 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:24,330 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:00:24,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:00:24,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327224344 (current time:1696327224344). 2023-10-03 10:00:24,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:00:24,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x67ce90c1 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:24,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bf968c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:24,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:24,355 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:24,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67ce90c1 to 127.0.0.1:56716 2023-10-03 10:00:24,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:24,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x55c5b2ed to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:24,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@469e680c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:24,366 DEBUG [hconnection-0x76919f5a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:24,369 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:24,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:24,375 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:24,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55c5b2ed to 127.0.0.1:56716 2023-10-03 10:00:24,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:24,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-03 10:00:24,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:00:24,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:00:24,381 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:00:24,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:00:24,384 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:00:24,385 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696327824385 2023-10-03 10:00:24,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:00:24,385 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-03 10:00:24,386 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:00:24,386 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:00:24,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-03 10:00:24,387 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:00:24,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-03 10:00:24,391 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-03 10:00:24,392 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696327824392 2023-10-03 10:00:24,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,411 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-03 10:00:24,411 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:24,413 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-03 10:00:24,413 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-03 10:00:24,413 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,413 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,415 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,415 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,415 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,415 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,416 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,416 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-03 10:00:24,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-03 10:00:24,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,417 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-03 10:00:24,417 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-03 10:00:24,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,417 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,417 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:00:24,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-03 10:00:24,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,418 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-03 10:00:24,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,418 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-03 10:00:24,418 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:24,418 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-03 10:00:24,419 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:24,422 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-03 10:00:24,422 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-03 10:00:24,422 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-03 10:00:24,422 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-03 10:00:24,422 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-03 10:00:24,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,422 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-03 10:00:24,422 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-03 10:00:24,422 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:24,424 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-03 10:00:24,424 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-03 10:00:24,424 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-03 10:00:24,425 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,425 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:24,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:24,432 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,432 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,432 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:24,432 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,432 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:24,433 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,433 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:24,433 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,433 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:24,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-03 10:00:24,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b35615c[Count = 1] remaining members to acquire global barrier 2023-10-03 10:00:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:24,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-03 10:00:24,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b35615c[Count = 0] remaining members to acquire global barrier 2023-10-03 10:00:24,437 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-03 10:00:24,437 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,438 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,438 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,438 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,438 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:00:24,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,438 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:00:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:00:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-03 10:00:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:00:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:24,439 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:24,439 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,439 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:00:24,439 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. started... 2023-10-03 10:00:24,440 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:24,441 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:24,441 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:24,441 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1eddb877635820bbde9ff1b2b8069772: 2023-10-03 10:00:24,441 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. started... 2023-10-03 10:00:24,442 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,442 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9574329802e8cf923e51d19e7e7b3d75: 2023-10-03 10:00:24,442 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:24,442 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:00:24,442 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,442 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:24,442 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:00:24,443 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-03 10:00:24,443 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:24,443 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-03 10:00:24,469 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. completed. 2023-10-03 10:00:24,469 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:24,469 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:24,469 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:24,470 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,470 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-03 10:00:24,470 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:00:24,471 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,472 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-03 10:00:24,472 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:24,472 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-03 10:00:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:24,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:24,473 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. completed. 2023-10-03 10:00:24,473 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:24,474 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:24,474 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:24,474 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,474 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-03 10:00:24,474 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:00:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:24,480 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,480 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-03 10:00:24,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,480 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:24,480 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-03 10:00:24,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:24,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42977,1696327199993': 2023-10-03 10:00:24,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-03 10:00:24,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:24,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:24,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:24,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:24,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:24,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,486 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:24,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-03 10:00:24,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:00:24,488 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:00:24,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34139,1696327200029': 2023-10-03 10:00:24,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-03 10:00:24,488 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-03 10:00:24,488 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:00:24,488 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:00:24,488 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,488 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:00:24,490 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,490 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,490 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,490 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,490 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,490 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,491 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,490 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:24,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,491 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,492 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,494 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:24,494 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,494 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,497 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,497 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,497 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,497 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,498 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,497 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,498 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,498 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,498 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,498 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,499 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,499 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,499 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-03 10:00:24,500 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,500 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,500 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:00:24,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,500 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,500 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,500 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-03 10:00:24,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-03 10:00:24,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,539 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:24,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696327224385Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696327224512 (+127 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696327224512Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696327224512Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696327224517 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696327224530 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696327224538 (+8 ms) 2023-10-03 10:00:24,541 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-03 10:00:24,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 155 msec 2023-10-03 10:00:24,688 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:24,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-03 10:00:24,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:00:24,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34139] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:00:24,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42977] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:00:24,701 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-03 10:00:24,701 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:24,701 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:00:24,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:00:24,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327224715 (current time:1696327224715). 2023-10-03 10:00:24,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:00:24,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x1f7aa63d to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:24,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ab06664, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:24,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:24,727 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:24,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f7aa63d to 127.0.0.1:56716 2023-10-03 10:00:24,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:24,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x68e3eed0 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:24,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22bbb6b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:24,739 DEBUG [hconnection-0x4a04e220-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:24,740 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:24,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:24,750 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:24,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68e3eed0 to 127.0.0.1:56716 2023-10-03 10:00:24,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:24,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-03 10:00:24,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:00:24,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:00:24,755 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:00:24,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:00:24,758 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:00:24,759 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696327824759 2023-10-03 10:00:24,759 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-03 10:00:24,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:00:24,760 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:00:24,760 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:00:24,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-03 10:00:24,761 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:00:24,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-03 10:00:24,764 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-03 10:00:24,765 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696327824765 2023-10-03 10:00:24,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-03 10:00:24,776 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-03 10:00:24,776 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:24,777 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-03 10:00:24,777 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-03 10:00:24,777 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,777 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,779 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,779 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,779 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,779 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,779 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,779 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,779 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,780 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:00:24,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-03 10:00:24,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,780 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-03 10:00:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-03 10:00:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-03 10:00:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,781 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-03 10:00:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,781 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-03 10:00:24,781 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:24,781 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-03 10:00:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-03 10:00:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-03 10:00:24,781 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-03 10:00:24,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-03 10:00:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-03 10:00:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-03 10:00:24,782 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:24,783 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-03 10:00:24,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-03 10:00:24,783 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-03 10:00:24,784 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-03 10:00:24,784 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:24,784 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-03 10:00:24,785 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-03 10:00:24,785 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-03 10:00:24,785 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-03 10:00:24,786 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,787 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,787 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:24,788 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:24,788 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,788 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,788 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:24,788 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,788 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:24,788 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,788 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-03 10:00:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:24,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-03 10:00:24,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a37ee36[Count = 1] remaining members to acquire global barrier 2023-10-03 10:00:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-03 10:00:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:24,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-03 10:00:24,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a37ee36[Count = 0] remaining members to acquire global barrier 2023-10-03 10:00:24,792 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-03 10:00:24,792 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,793 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,793 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,793 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:00:24,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:00:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:00:24,794 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-03 10:00:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:24,794 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:00:24,794 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. started... 2023-10-03 10:00:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:24,794 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:24,794 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:24,794 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,795 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1eddb877635820bbde9ff1b2b8069772 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-03 10:00:24,794 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. started... 2023-10-03 10:00:24,795 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:00:24,795 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9574329802e8cf923e51d19e7e7b3d75 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-03 10:00:24,797 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-03 10:00:24,797 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:24,797 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-03 10:00:24,831 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231003ebb6a556aed84199a7a35d7afe53c49e to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231003ebb6a556aed84199a7a35d7afe53c49e 2023-10-03 10:00:24,837 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231003d92ebb0efa9241618cd5539e29edf151 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231003d92ebb0efa9241618cd5539e29edf151 2023-10-03 10:00:24,848 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/.tmp/cf/a0b4f068469e4a078912530498d81221 2023-10-03 10:00:24,851 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/.tmp/cf/0eb0b0f659e64f34b44a6f78a6543390 2023-10-03 10:00:24,855 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/.tmp/cf/a0b4f068469e4a078912530498d81221 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/cf/a0b4f068469e4a078912530498d81221 2023-10-03 10:00:24,858 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/.tmp/cf/0eb0b0f659e64f34b44a6f78a6543390 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/cf/0eb0b0f659e64f34b44a6f78a6543390 2023-10-03 10:00:24,860 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:24,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-03 10:00:24,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:00:24,862 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:00:24,864 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/cf/a0b4f068469e4a078912530498d81221, entries=2, sequenceid=6, filesize=5.2 K 2023-10-03 10:00:24,865 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 9574329802e8cf923e51d19e7e7b3d75 in 70ms, sequenceid=6, compaction requested=false 2023-10-03 10:00:24,865 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-03 10:00:24,866 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9574329802e8cf923e51d19e7e7b3d75: 2023-10-03 10:00:24,866 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-03 10:00:24,866 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:24,866 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/cf/a0b4f068469e4a078912530498d81221] hfiles 2023-10-03 10:00:24,866 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/cf/a0b4f068469e4a078912530498d81221 for snapshot=snaptb0-testExportFileSystemState 2023-10-03 10:00:24,868 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/cf/0eb0b0f659e64f34b44a6f78a6543390, entries=48, sequenceid=6, filesize=13.0 K 2023-10-03 10:00:24,870 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 1eddb877635820bbde9ff1b2b8069772 in 75ms, sequenceid=6, compaction requested=false 2023-10-03 10:00:24,871 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1eddb877635820bbde9ff1b2b8069772: 2023-10-03 10:00:24,872 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-03 10:00:24,872 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:24,872 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/cf/0eb0b0f659e64f34b44a6f78a6543390] hfiles 2023-10-03 10:00:24,872 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/cf/0eb0b0f659e64f34b44a6f78a6543390 for snapshot=snaptb0-testExportFileSystemState 2023-10-03 10:00:24,891 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. completed. 2023-10-03 10:00:24,891 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:24,891 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:24,891 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:24,891 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,891 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-03 10:00:24,891 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:00:24,895 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. completed. 2023-10-03 10:00:24,896 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:24,896 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:24,896 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:24,896 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,896 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-03 10:00:24,896 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:00:24,896 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-03 10:00:24,896 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:24,896 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,896 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-03 10:00:24,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:24,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:24,899 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:24,899 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-03 10:00:24,900 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:24,900 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-03 10:00:24,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:24,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-03 10:00:24,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:24,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-03 10:00:24,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34139,1696327200029': 2023-10-03 10:00:24,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-03 10:00:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-03 10:00:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-03 10:00:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42977,1696327199993': 2023-10-03 10:00:24,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-03 10:00:24,909 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-03 10:00:24,909 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:00:24,909 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:00:24,909 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-03 10:00:24,909 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:00:24,911 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:24,912 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,912 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,912 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,912 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-03 10:00:24,913 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:24,914 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-03 10:00:24,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:24,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-03 10:00:24,916 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,917 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,917 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,921 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,921 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,921 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,921 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,921 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,921 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,921 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:24,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,921 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:24,921 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-03 10:00:24,921 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,921 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:24,921 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:24,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,923 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:24,923 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-03 10:00:24,924 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:24,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-03 10:00:24,924 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:00:24,924 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:24,924 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:24,924 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,924 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:24,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:24,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231003d92ebb0efa9241618cd5539e29edf151, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231003ebb6a556aed84199a7a35d7afe53c49e] mob files 2023-10-03 10:00:24,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231003d92ebb0efa9241618cd5539e29edf151 2023-10-03 10:00:24,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231003ebb6a556aed84199a7a35d7afe53c49e 2023-10-03 10:00:24,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-03 10:00:24,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-03 10:00:24,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,963 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-03 10:00:24,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696327224759Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696327224939 (+180 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696327224939Loading Region manifests for snaptb0-testExportFileSystemState at 1696327224939Writing data manifest for snaptb0-testExportFileSystemState at 1696327224944 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696327224954 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696327224963 (+9 ms) 2023-10-03 10:00:24,966 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-03 10:00:24,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 206 msec 2023-10-03 10:00:25,062 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:25,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-03 10:00:25,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:00:25,064 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327225064 2023-10-03 10:00:25,064 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36071, tgtDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327225064, rawTgtDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327225064, srcFsUri=hdfs://localhost:36071, srcDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:25,093 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:25,094 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1147333025_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327225064, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327225064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-03 10:00:25,094 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead, snapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-03 10:00:25,105 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327225064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-03 10:00:25,142 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,142 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,143 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,143 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,144 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,144 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,145 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,218 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop-6744835819087182555.jar 2023-10-03 10:00:25,219 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,219 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,220 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,220 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,220 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,221 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:25,221 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-03 10:00:25,221 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-03 10:00:25,222 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-03 10:00:25,222 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-03 10:00:25,222 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-03 10:00:25,223 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-03 10:00:25,223 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-03 10:00:25,224 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-03 10:00:25,224 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-03 10:00:25,224 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-03 10:00:25,225 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:25,225 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:25,226 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:25,226 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:25,226 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:25,227 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:25,227 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:25,709 WARN [Listener at jenkins-hbase4.apache.org/39739] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-03 10:00:25,712 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-03 10:00:25,714 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-03 10:00:27,649 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:00:27,649 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:00:27,654 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0001_000001 (auth:SIMPLE) 2023-10-03 10:00:28,416 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0002_000001 (auth:SIMPLE) 2023-10-03 10:00:29,000 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-03 10:00:32,509 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0002_000001 (auth:SIMPLE) 2023-10-03 10:00:34,745 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0002_000001 (auth:SIMPLE) 2023-10-03 10:00:38,116 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0002_000001 (auth:SIMPLE) 2023-10-03 10:00:39,931 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-03 10:00:39,932 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-03 10:00:39,941 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-03 10:00:39,941 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-03 10:00:39,941 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-03 10:00:39,942 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-03 10:00:39,942 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-03 10:00:39,942 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-03 10:00:39,942 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327225064/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327225064/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-03 10:00:39,943 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327225064/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-03 10:00:39,943 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327225064/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-03 10:00:39,950 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-03 10:00:39,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-03 10:00:39,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-03 10:00:39,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-03 10:00:39,956 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327239956"}]},"ts":"1696327239956"} 2023-10-03 10:00:39,958 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-03 10:00:39,960 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-03 10:00:39,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9574329802e8cf923e51d19e7e7b3d75, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1eddb877635820bbde9ff1b2b8069772, UNASSIGN}] 2023-10-03 10:00:39,963 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9574329802e8cf923e51d19e7e7b3d75, UNASSIGN 2023-10-03 10:00:39,963 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1eddb877635820bbde9ff1b2b8069772, UNASSIGN 2023-10-03 10:00:39,964 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9574329802e8cf923e51d19e7e7b3d75, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:39,964 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=1eddb877635820bbde9ff1b2b8069772, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:39,964 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696327239964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327239964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327239964"}]},"ts":"1696327239964"} 2023-10-03 10:00:39,964 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696327239964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327239964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327239964"}]},"ts":"1696327239964"} 2023-10-03 10:00:39,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 9574329802e8cf923e51d19e7e7b3d75, server=jenkins-hbase4.apache.org,34139,1696327200029}] 2023-10-03 10:00:39,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 1eddb877635820bbde9ff1b2b8069772, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:00:40,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-03 10:00:40,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:40,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9574329802e8cf923e51d19e7e7b3d75, disabling compactions & flushes 2023-10-03 10:00:40,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:40,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:40,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. after waiting 0 ms 2023-10-03 10:00:40,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:40,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:40,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1eddb877635820bbde9ff1b2b8069772, disabling compactions & flushes 2023-10-03 10:00:40,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:40,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:40,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. after waiting 0 ms 2023-10-03 10:00:40,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:40,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:00:40,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:00:40,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:00:40,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:00:40,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75. 2023-10-03 10:00:40,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772. 2023-10-03 10:00:40,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9574329802e8cf923e51d19e7e7b3d75: 2023-10-03 10:00:40,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1eddb877635820bbde9ff1b2b8069772: 2023-10-03 10:00:40,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:40,135 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=1eddb877635820bbde9ff1b2b8069772, regionState=CLOSED 2023-10-03 10:00:40,135 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696327240135"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327240135"}]},"ts":"1696327240135"} 2023-10-03 10:00:40,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:40,136 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9574329802e8cf923e51d19e7e7b3d75, regionState=CLOSED 2023-10-03 10:00:40,136 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696327240136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327240136"}]},"ts":"1696327240136"} 2023-10-03 10:00:40,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-03 10:00:40,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 1eddb877635820bbde9ff1b2b8069772, server=jenkins-hbase4.apache.org,42977,1696327199993 in 171 msec 2023-10-03 10:00:40,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-03 10:00:40,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 9574329802e8cf923e51d19e7e7b3d75, server=jenkins-hbase4.apache.org,34139,1696327200029 in 173 msec 2023-10-03 10:00:40,141 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1eddb877635820bbde9ff1b2b8069772, UNASSIGN in 179 msec 2023-10-03 10:00:40,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-03 10:00:40,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9574329802e8cf923e51d19e7e7b3d75, UNASSIGN in 180 msec 2023-10-03 10:00:40,143 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327240143"}]},"ts":"1696327240143"} 2023-10-03 10:00:40,144 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-03 10:00:40,146 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-03 10:00:40,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 196 msec 2023-10-03 10:00:40,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-03 10:00:40,259 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-03 10:00:40,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-03 10:00:40,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-03 10:00:40,263 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-03 10:00:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-03 10:00:40,264 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-03 10:00:40,265 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-03 10:00:40,269 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-03 10:00:40,270 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-03 10:00:40,270 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-03 10:00:40,270 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-03 10:00:40,270 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:40,270 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:40,270 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-03 10:00:40,270 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-03 10:00:40,270 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-03 10:00:40,270 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-03 10:00:40,271 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-03 10:00:40,271 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-03 10:00:40,271 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:40,271 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-03 10:00:40,271 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:40,272 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:40,271 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-03 10:00:40,272 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:40,273 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/recovered.edits] 2023-10-03 10:00:40,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-03 10:00:40,273 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/recovered.edits] 2023-10-03 10:00:40,278 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/cf/a0b4f068469e4a078912530498d81221 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/cf/a0b4f068469e4a078912530498d81221 2023-10-03 10:00:40,278 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/cf/0eb0b0f659e64f34b44a6f78a6543390 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/cf/0eb0b0f659e64f34b44a6f78a6543390 2023-10-03 10:00:40,282 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75/recovered.edits/9.seqid 2023-10-03 10:00:40,282 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772/recovered.edits/9.seqid 2023-10-03 10:00:40,283 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/9574329802e8cf923e51d19e7e7b3d75 2023-10-03 10:00:40,283 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemState/1eddb877635820bbde9ff1b2b8069772 2023-10-03 10:00:40,283 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-03 10:00:40,284 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-03 10:00:40,285 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-03 10:00:40,290 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231003d92ebb0efa9241618cd5539e29edf151 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231003d92ebb0efa9241618cd5539e29edf151 2023-10-03 10:00:40,292 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231003ebb6a556aed84199a7a35d7afe53c49e to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231003ebb6a556aed84199a7a35d7afe53c49e 2023-10-03 10:00:40,293 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-03 10:00:40,296 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-03 10:00:40,299 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-03 10:00:40,306 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-03 10:00:40,308 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-03 10:00:40,308 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-03 10:00:40,308 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327240308"}]},"ts":"9223372036854775807"} 2023-10-03 10:00:40,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327240308"}]},"ts":"9223372036854775807"} 2023-10-03 10:00:40,311 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-03 10:00:40,312 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9574329802e8cf923e51d19e7e7b3d75, NAME => 'testtb-testExportFileSystemState,,1696327223713.9574329802e8cf923e51d19e7e7b3d75.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1eddb877635820bbde9ff1b2b8069772, NAME => 'testtb-testExportFileSystemState,1,1696327223713.1eddb877635820bbde9ff1b2b8069772.', STARTKEY => '1', ENDKEY => ''}] 2023-10-03 10:00:40,312 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-03 10:00:40,312 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696327240312"}]},"ts":"9223372036854775807"} 2023-10-03 10:00:40,314 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-03 10:00:40,317 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-03 10:00:40,322 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 57 msec 2023-10-03 10:00:40,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-03 10:00:40,375 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-03 10:00:40,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-03 10:00:40,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-03 10:00:40,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-03 10:00:40,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-03 10:00:40,427 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=760 (was 753) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2120777879_1 at /127.0.0.1:56934 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:50878 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:41572 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2120777879_1 at /127.0.0.1:41544 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:33049 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:56960 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=940 (was 932) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=284 (was 327), ProcessCount=168 (was 168), AvailableMemoryMB=8157 (was 8294) 2023-10-03 10:00:40,427 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-10-03 10:00:40,452 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=760, OpenFileDescriptor=940, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=168, AvailableMemoryMB=8157 2023-10-03 10:00:40,452 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-10-03 10:00:40,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-03 10:00:40,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-03 10:00:40,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-03 10:00:40,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-03 10:00:40,460 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-03 10:00:40,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-03 10:00:40,463 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea 2023-10-03 10:00:40,463 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b 2023-10-03 10:00:40,464 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea empty. 2023-10-03 10:00:40,464 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b empty. 2023-10-03 10:00:40,464 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea 2023-10-03 10:00:40,464 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b 2023-10-03 10:00:40,464 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-03 10:00:40,476 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-03 10:00:40,478 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 24393e1104e3ef6b17043182475ebbea, NAME => 'testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:00:40,478 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 438b88ed959c489b2e205a5c514d013b, NAME => 'testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:00:40,494 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:40,494 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 24393e1104e3ef6b17043182475ebbea, disabling compactions & flushes 2023-10-03 10:00:40,494 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:40,494 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:40,494 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. after waiting 0 ms 2023-10-03 10:00:40,494 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:40,494 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:40,494 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 24393e1104e3ef6b17043182475ebbea: 2023-10-03 10:00:40,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:40,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 438b88ed959c489b2e205a5c514d013b, disabling compactions & flushes 2023-10-03 10:00:40,503 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:40,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:40,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. after waiting 0 ms 2023-10-03 10:00:40,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:40,503 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:40,503 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 438b88ed959c489b2e205a5c514d013b: 2023-10-03 10:00:40,506 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-03 10:00:40,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696327240507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327240507"}]},"ts":"1696327240507"} 2023-10-03 10:00:40,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696327240507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327240507"}]},"ts":"1696327240507"} 2023-10-03 10:00:40,510 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-03 10:00:40,511 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-03 10:00:40,511 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327240511"}]},"ts":"1696327240511"} 2023-10-03 10:00:40,513 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-03 10:00:40,518 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-03 10:00:40,519 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-03 10:00:40,519 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-03 10:00:40,519 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-03 10:00:40,519 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-03 10:00:40,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24393e1104e3ef6b17043182475ebbea, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=438b88ed959c489b2e205a5c514d013b, ASSIGN}] 2023-10-03 10:00:40,522 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=438b88ed959c489b2e205a5c514d013b, ASSIGN 2023-10-03 10:00:40,523 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24393e1104e3ef6b17043182475ebbea, ASSIGN 2023-10-03 10:00:40,523 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=438b88ed959c489b2e205a5c514d013b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36133,1696327199942; forceNewPlan=false, retain=false 2023-10-03 10:00:40,523 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24393e1104e3ef6b17043182475ebbea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34139,1696327200029; forceNewPlan=false, retain=false 2023-10-03 10:00:40,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-03 10:00:40,674 INFO [jenkins-hbase4:33857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-03 10:00:40,676 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=24393e1104e3ef6b17043182475ebbea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:40,676 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=438b88ed959c489b2e205a5c514d013b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:40,677 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696327240676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327240676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327240676"}]},"ts":"1696327240676"} 2023-10-03 10:00:40,677 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696327240676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327240676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327240676"}]},"ts":"1696327240676"} 2023-10-03 10:00:40,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 24393e1104e3ef6b17043182475ebbea, server=jenkins-hbase4.apache.org,34139,1696327200029}] 2023-10-03 10:00:40,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 438b88ed959c489b2e205a5c514d013b, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:00:40,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-03 10:00:40,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:40,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 24393e1104e3ef6b17043182475ebbea, NAME => 'testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.', STARTKEY => '', ENDKEY => '1'} 2023-10-03 10:00:40,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:40,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. service=AccessControlService 2023-10-03 10:00:40,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 438b88ed959c489b2e205a5c514d013b, NAME => 'testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.', STARTKEY => '1', ENDKEY => ''} 2023-10-03 10:00:40,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:40,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. service=AccessControlService 2023-10-03 10:00:40,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 24393e1104e3ef6b17043182475ebbea 2023-10-03 10:00:40,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:00:40,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:40,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 438b88ed959c489b2e205a5c514d013b 2023-10-03 10:00:40,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 24393e1104e3ef6b17043182475ebbea 2023-10-03 10:00:40,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:00:40,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 24393e1104e3ef6b17043182475ebbea 2023-10-03 10:00:40,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 438b88ed959c489b2e205a5c514d013b 2023-10-03 10:00:40,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 438b88ed959c489b2e205a5c514d013b 2023-10-03 10:00:40,839 INFO [StoreOpener-24393e1104e3ef6b17043182475ebbea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 24393e1104e3ef6b17043182475ebbea 2023-10-03 10:00:40,839 INFO [StoreOpener-438b88ed959c489b2e205a5c514d013b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 438b88ed959c489b2e205a5c514d013b 2023-10-03 10:00:40,840 DEBUG [StoreOpener-24393e1104e3ef6b17043182475ebbea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/cf 2023-10-03 10:00:40,840 DEBUG [StoreOpener-24393e1104e3ef6b17043182475ebbea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/cf 2023-10-03 10:00:40,840 DEBUG [StoreOpener-438b88ed959c489b2e205a5c514d013b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/cf 2023-10-03 10:00:40,841 DEBUG [StoreOpener-438b88ed959c489b2e205a5c514d013b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/cf 2023-10-03 10:00:40,841 INFO [StoreOpener-24393e1104e3ef6b17043182475ebbea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24393e1104e3ef6b17043182475ebbea columnFamilyName cf 2023-10-03 10:00:40,841 INFO [StoreOpener-438b88ed959c489b2e205a5c514d013b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 438b88ed959c489b2e205a5c514d013b columnFamilyName cf 2023-10-03 10:00:40,842 INFO [StoreOpener-438b88ed959c489b2e205a5c514d013b-1] regionserver.HStore(310): Store=438b88ed959c489b2e205a5c514d013b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:40,842 INFO [StoreOpener-24393e1104e3ef6b17043182475ebbea-1] regionserver.HStore(310): Store=24393e1104e3ef6b17043182475ebbea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:00:40,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b 2023-10-03 10:00:40,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea 2023-10-03 10:00:40,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b 2023-10-03 10:00:40,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea 2023-10-03 10:00:40,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 438b88ed959c489b2e205a5c514d013b 2023-10-03 10:00:40,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 24393e1104e3ef6b17043182475ebbea 2023-10-03 10:00:40,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:00:40,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:00:40,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 24393e1104e3ef6b17043182475ebbea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66524023, jitterRate=-0.008714810013771057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:00:40,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 24393e1104e3ef6b17043182475ebbea: 2023-10-03 10:00:40,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 438b88ed959c489b2e205a5c514d013b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66826335, jitterRate=-0.0042100101709365845}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:00:40,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 438b88ed959c489b2e205a5c514d013b: 2023-10-03 10:00:40,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea., pid=45, masterSystemTime=1696327240831 2023-10-03 10:00:40,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b., pid=46, masterSystemTime=1696327240832 2023-10-03 10:00:40,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:40,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:40,854 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=24393e1104e3ef6b17043182475ebbea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:40,854 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696327240854"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327240854"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327240854"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327240854"}]},"ts":"1696327240854"} 2023-10-03 10:00:40,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:40,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:40,855 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=438b88ed959c489b2e205a5c514d013b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:40,855 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696327240855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327240855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327240855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327240855"}]},"ts":"1696327240855"} 2023-10-03 10:00:40,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-03 10:00:40,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 24393e1104e3ef6b17043182475ebbea, server=jenkins-hbase4.apache.org,34139,1696327200029 in 177 msec 2023-10-03 10:00:40,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-03 10:00:40,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 438b88ed959c489b2e205a5c514d013b, server=jenkins-hbase4.apache.org,36133,1696327199942 in 177 msec 2023-10-03 10:00:40,860 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24393e1104e3ef6b17043182475ebbea, ASSIGN in 339 msec 2023-10-03 10:00:40,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-10-03 10:00:40,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=438b88ed959c489b2e205a5c514d013b, ASSIGN in 340 msec 2023-10-03 10:00:40,862 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-03 10:00:40,862 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327240862"}]},"ts":"1696327240862"} 2023-10-03 10:00:40,863 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-03 10:00:40,865 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-03 10:00:40,866 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-03 10:00:40,867 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-03 10:00:40,869 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:40,869 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:40,869 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:40,869 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:00:40,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:40,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:40,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:40,870 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-03 10:00:40,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 415 msec 2023-10-03 10:00:41,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-03 10:00:41,065 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-03 10:00:41,068 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-03 10:00:41,068 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:41,069 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:00:41,078 DEBUG [hconnection-0x6026727-shared-pool-17] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:41,083 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:41,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-03 10:00:41,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327241086 (current time:1696327241086). 2023-10-03 10:00:41,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:00:41,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x5d918d84 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:41,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@378990bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:41,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:41,100 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:41,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d918d84 to 127.0.0.1:56716 2023-10-03 10:00:41,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:41,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x43ed472e to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:41,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12410f7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:41,113 DEBUG [hconnection-0x693679e5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:41,115 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:41,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:41,120 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:41,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43ed472e to 127.0.0.1:56716 2023-10-03 10:00:41,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:41,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-03 10:00:41,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:00:41,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-03 10:00:41,125 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:00:41,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-03 10:00:41,128 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-03 10:00:41,128 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696327841128 2023-10-03 10:00:41,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-03 10:00:41,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-03 10:00:41,131 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-03 10:00:41,131 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:00:41,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-03 10:00:41,131 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:00:41,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-03 10:00:41,133 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-03 10:00:41,134 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696327841134 2023-10-03 10:00:41,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,145 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-03 10:00:41,145 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:41,146 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-03 10:00:41,146 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-03 10:00:41,147 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,147 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,152 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,152 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,152 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,152 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,152 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,152 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,153 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,153 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:00:41,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-03 10:00:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-03 10:00:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-03 10:00:41,154 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-03 10:00:41,154 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-03 10:00:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,154 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-03 10:00:41,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-03 10:00:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-03 10:00:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:41,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-03 10:00:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-03 10:00:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-03 10:00:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:41,156 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:41,157 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-03 10:00:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-03 10:00:41,160 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-03 10:00:41,160 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-03 10:00:41,160 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-03 10:00:41,160 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-03 10:00:41,160 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-03 10:00:41,162 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,162 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,163 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:41,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:41,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-03 10:00:41,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63528121[Count = 1] remaining members to acquire global barrier 2023-10-03 10:00:41,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:41,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:41,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:41,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:41,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:41,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-03 10:00:41,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63528121[Count = 0] remaining members to acquire global barrier 2023-10-03 10:00:41,168 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-03 10:00:41,168 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,170 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,170 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,170 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-03 10:00:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-03 10:00:41,170 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:00:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-03 10:00:41,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,170 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,170 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:00:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-03 10:00:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:41,170 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:41,170 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:41,171 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:41,171 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. started... 2023-10-03 10:00:41,171 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:41,171 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. started... 2023-10-03 10:00:41,172 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 438b88ed959c489b2e205a5c514d013b: 2023-10-03 10:00:41,172 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 24393e1104e3ef6b17043182475ebbea: 2023-10-03 10:00:41,172 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,172 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,173 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:41,173 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:41,173 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:00:41,173 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:00:41,178 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-03 10:00:41,178 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:41,178 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-03 10:00:41,192 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. completed. 2023-10-03 10:00:41,192 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:41,192 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:41,192 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:41,192 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,192 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-03 10:00:41,192 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:00:41,194 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. completed. 2023-10-03 10:00:41,194 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:41,195 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-03 10:00:41,195 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,195 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:41,195 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:41,195 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:41,195 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:41,197 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-03 10:00:41,195 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-03 10:00:41,197 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:00:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:41,199 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-03 10:00:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-03 10:00:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34139,1696327200029': 2023-10-03 10:00:41,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-03 10:00:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:41,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:41,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:41,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:41,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36133,1696327199942': 2023-10-03 10:00:41,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-03 10:00:41,208 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-03 10:00:41,208 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:00:41,208 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:00:41,208 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,208 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:00:41,210 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,210 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,210 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:41,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:41,210 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,210 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,210 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,210 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,210 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:41,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,211 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:41,211 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:41,213 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,213 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,214 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,218 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,219 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,219 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,219 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,219 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,219 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,219 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,219 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:41,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,219 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-03 10:00:41,219 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,221 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:00:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,221 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,222 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,222 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,222 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,222 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,222 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,222 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-03 10:00:41,231 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:41,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-03 10:00:41,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:00:41,234 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:00:41,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-03 10:00:41,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,264 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-03 10:00:41,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696327241129Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696327241232 (+103 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696327241232Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696327241232Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696327241240 (+8 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696327241257 (+17 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696327241264 (+7 ms) 2023-10-03 10:00:41,269 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-03 10:00:41,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 139 msec 2023-10-03 10:00:41,434 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:41,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-03 10:00:41,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:00:41,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34139] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:00:41,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36133] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:00:41,443 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-03 10:00:41,443 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:41,443 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:00:41,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-03 10:00:41,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327241453 (current time:1696327241453). 2023-10-03 10:00:41,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:00:41,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x2bd42875 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:41,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70640198, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:41,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:41,469 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:41,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bd42875 to 127.0.0.1:56716 2023-10-03 10:00:41,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:41,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x2cc88fdd to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:00:41,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26558db1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:00:41,484 DEBUG [hconnection-0x766d3022-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:41,487 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:41,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:00:41,494 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:00:41,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cc88fdd to 127.0.0.1:56716 2023-10-03 10:00:41,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:00:41,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-03 10:00:41,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:00:41,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-03 10:00:41,500 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:00:41,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-03 10:00:41,503 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-03 10:00:41,504 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696327841504 2023-10-03 10:00:41,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-03 10:00:41,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-03 10:00:41,504 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:00:41,506 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:00:41,508 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-03 10:00:41,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-03 10:00:41,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-10-03 10:00:41,511 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-03 10:00:41,511 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696327841511 2023-10-03 10:00:41,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-03 10:00:41,534 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-03 10:00:41,534 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:41,536 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-03 10:00:41,536 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-03 10:00:41,536 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,536 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,538 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,538 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,538 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,538 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,538 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,538 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,539 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,539 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:00:41,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-03 10:00:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-03 10:00:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-03 10:00:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,540 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-03 10:00:41,540 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-03 10:00:41,540 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-03 10:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-03 10:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-03 10:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-03 10:00:41,540 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-03 10:00:41,540 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-03 10:00:41,540 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:41,540 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-03 10:00:41,541 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-03 10:00:41,540 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:41,542 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-03 10:00:41,541 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:00:41,543 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-03 10:00:41,542 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-03 10:00:41,543 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-03 10:00:41,543 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-03 10:00:41,543 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-03 10:00:41,543 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-03 10:00:41,544 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-03 10:00:41,545 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,546 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,546 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,546 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:41,546 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,546 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:41,546 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,546 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,546 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:41,546 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,547 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:00:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-03 10:00:41,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:41,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-03 10:00:41,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58016d98[Count = 1] remaining members to acquire global barrier 2023-10-03 10:00:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-03 10:00:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:41,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-03 10:00:41,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58016d98[Count = 0] remaining members to acquire global barrier 2023-10-03 10:00:41,551 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-03 10:00:41,551 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,553 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,553 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,553 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,553 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-03 10:00:41,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,553 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,553 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-03 10:00:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,553 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:41,553 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-03 10:00:41,553 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:41,553 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-03 10:00:41,554 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. started... 2023-10-03 10:00:41,554 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:00:41,553 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:41,554 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 24393e1104e3ef6b17043182475ebbea 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-03 10:00:41,554 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,554 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:00:41,554 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:00:41,554 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:00:41,554 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:41,554 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. started... 2023-10-03 10:00:41,555 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 438b88ed959c489b2e205a5c514d013b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-03 10:00:41,566 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-03 10:00:41,566 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:41,566 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-03 10:00:41,590 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310033c680c4f3c0c4e79ae9fa7a864825bf4 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310033c680c4f3c0c4e79ae9fa7a864825bf4 2023-10-03 10:00:41,593 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100303166e21786c4fb6a26732fc9c492b72 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100303166e21786c4fb6a26732fc9c492b72 2023-10-03 10:00:41,601 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/.tmp/cf/660e434c9f5f443ba95dfdd0616c059a 2023-10-03 10:00:41,605 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/.tmp/cf/30d6c1d0be5441b6869a52c537faf302 2023-10-03 10:00:41,606 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:41,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-03 10:00:41,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:00:41,607 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/.tmp/cf/660e434c9f5f443ba95dfdd0616c059a as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/cf/660e434c9f5f443ba95dfdd0616c059a 2023-10-03 10:00:41,607 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:00:41,611 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/.tmp/cf/30d6c1d0be5441b6869a52c537faf302 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/cf/30d6c1d0be5441b6869a52c537faf302 2023-10-03 10:00:41,613 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/cf/660e434c9f5f443ba95dfdd0616c059a, entries=3, sequenceid=6, filesize=5.4 K 2023-10-03 10:00:41,614 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 24393e1104e3ef6b17043182475ebbea in 60ms, sequenceid=6, compaction requested=false 2023-10-03 10:00:41,614 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-03 10:00:41,614 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 24393e1104e3ef6b17043182475ebbea: 2023-10-03 10:00:41,614 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-03 10:00:41,615 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:41,615 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/cf/660e434c9f5f443ba95dfdd0616c059a] hfiles 2023-10-03 10:00:41,615 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/cf/660e434c9f5f443ba95dfdd0616c059a for snapshot=snaptb0-testConsecutiveExports 2023-10-03 10:00:41,617 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/cf/30d6c1d0be5441b6869a52c537faf302, entries=47, sequenceid=6, filesize=12.7 K 2023-10-03 10:00:41,617 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 438b88ed959c489b2e205a5c514d013b in 62ms, sequenceid=6, compaction requested=false 2023-10-03 10:00:41,619 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 438b88ed959c489b2e205a5c514d013b: 2023-10-03 10:00:41,619 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-03 10:00:41,619 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:00:41,619 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/cf/30d6c1d0be5441b6869a52c537faf302] hfiles 2023-10-03 10:00:41,619 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/cf/30d6c1d0be5441b6869a52c537faf302 for snapshot=snaptb0-testConsecutiveExports 2023-10-03 10:00:41,629 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. completed. 2023-10-03 10:00:41,629 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:00:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-03 10:00:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:00:41,631 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-03 10:00:41,631 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:41,631 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-03 10:00:41,633 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:41,633 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. completed. 2023-10-03 10:00:41,633 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:00:41,634 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:00:41,634 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:00:41,634 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,634 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-03 10:00:41,634 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:00:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:41,635 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-03 10:00:41,635 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-03 10:00:41,636 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:41,636 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-03 10:00:41,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-03 10:00:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34139,1696327200029': 2023-10-03 10:00:41,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-03 10:00:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-03 10:00:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-03 10:00:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36133,1696327199942': 2023-10-03 10:00:41,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-03 10:00:41,643 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-03 10:00:41,643 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:00:41,643 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:00:41,643 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-03 10:00:41,643 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:00:41,646 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,646 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:00:41,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:00:41,646 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,646 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,646 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,646 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:00:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,646 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,647 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-03 10:00:41,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,647 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:00:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,648 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-03 10:00:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:00:41,650 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-03 10:00:41,650 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,650 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,656 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,656 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,656 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,656 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,656 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,656 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,656 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,656 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,656 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:00:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:00:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-03 10:00:41,657 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:00:41,657 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:00:41,659 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:00:41,659 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-03 10:00:41,657 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:00:41,659 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:00:41,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-03 10:00:41,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:00:41,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:00:41,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:00:41,659 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:00:41,660 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,660 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100303166e21786c4fb6a26732fc9c492b72, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310033c680c4f3c0c4e79ae9fa7a864825bf4] mob files 2023-10-03 10:00:41,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100303166e21786c4fb6a26732fc9c492b72 2023-10-03 10:00:41,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310033c680c4f3c0c4e79ae9fa7a864825bf4 2023-10-03 10:00:41,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-03 10:00:41,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-03 10:00:41,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,699 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696327241504Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696327241670 (+166 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696327241670Loading Region manifests for snaptb0-testConsecutiveExports at 1696327241670Writing data manifest for snaptb0-testConsecutiveExports at 1696327241677 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696327241690 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696327241699 (+9 ms) 2023-10-03 10:00:41,702 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-03 10:00:41,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 196 msec 2023-10-03 10:00:41,808 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:00:41,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-03 10:00:41,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:00:41,809 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809 2023-10-03 10:00:41,810 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809, srcFsUri=hdfs://localhost:36071, srcDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:41,831 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:41,831 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7053fd9e, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,831 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead, snapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-03 10:00:41,840 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-03 10:00:41,852 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,852 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,852 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,853 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,853 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,853 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,854 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,921 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop-359340423758985212.jar 2023-10-03 10:00:41,922 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,922 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,923 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,923 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,923 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,924 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:41,924 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-03 10:00:41,924 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-03 10:00:41,925 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-03 10:00:41,925 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-03 10:00:41,925 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-03 10:00:41,926 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-03 10:00:41,926 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-03 10:00:41,927 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-03 10:00:41,927 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-03 10:00:41,927 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-03 10:00:41,928 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:41,928 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:41,929 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:41,929 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:41,929 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:41,929 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:41,930 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:42,311 WARN [Listener at jenkins-hbase4.apache.org/39739] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-03 10:00:42,314 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-03 10:00:42,316 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-03 10:00:44,296 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:00:44,296 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:00:44,300 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0002_000001 (auth:SIMPLE) 2023-10-03 10:00:45,097 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0003_000001 (auth:SIMPLE) 2023-10-03 10:00:45,728 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-03 10:00:49,063 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0003_000001 (auth:SIMPLE) 2023-10-03 10:00:51,289 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0003_000001 (auth:SIMPLE) 2023-10-03 10:00:54,308 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0003_000001 (auth:SIMPLE) 2023-10-03 10:00:55,494 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-03 10:00:55,494 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-03 10:00:55,499 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-03 10:00:55,499 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-03 10:00:55,499 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-03 10:00:55,500 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-03 10:00:55,502 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-03 10:00:55,502 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-03 10:00:55,502 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@15558e3e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-03 10:00:55,503 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-03 10:00:55,503 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-03 10:00:55,504 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809, srcFsUri=hdfs://localhost:36071, srcDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:55,525 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:00:55,525 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@35b96ac4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-03 10:00:55,525 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead, snapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-03 10:00:55,536 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-03 10:00:55,547 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,548 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,548 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,549 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,549 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,549 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,549 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,617 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop-3086751290043149716.jar 2023-10-03 10:00:55,618 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,618 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,619 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,619 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,619 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,620 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-03 10:00:55,620 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-03 10:00:55,620 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-03 10:00:55,621 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-03 10:00:55,621 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-03 10:00:55,621 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-03 10:00:55,622 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-03 10:00:55,622 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-03 10:00:55,623 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-03 10:00:55,623 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-03 10:00:55,623 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-03 10:00:55,624 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:55,624 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:55,624 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:55,625 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:55,625 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:00:55,625 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:55,626 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:00:55,987 WARN [Listener at jenkins-hbase4.apache.org/39739] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-03 10:00:55,990 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-03 10:00:55,992 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-03 10:01:00,481 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:01:00,481 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:01:00,484 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0003_000001 (auth:SIMPLE) 2023-10-03 10:01:01,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0004_000001 (auth:SIMPLE) 2023-10-03 10:01:04,960 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0004_000001 (auth:SIMPLE) 2023-10-03 10:01:07,174 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0004_000001 (auth:SIMPLE) 2023-10-03 10:01:09,343 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0004_000001 (auth:SIMPLE) 2023-10-03 10:01:11,176 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-03 10:01:11,176 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-03 10:01:11,179 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-03 10:01:11,179 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-03 10:01:11,180 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-03 10:01:11,180 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-03 10:01:11,184 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-03 10:01:11,184 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-03 10:01:11,184 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@15558e3e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-03 10:01:11,185 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-03 10:01:11,185 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/local-export-1696327241809/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-03 10:01:11,198 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-03 10:01:11,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-03 10:01:11,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-03 10:01:11,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-03 10:01:11,202 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327271202"}]},"ts":"1696327271202"} 2023-10-03 10:01:11,204 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-03 10:01:11,206 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-03 10:01:11,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24393e1104e3ef6b17043182475ebbea, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=438b88ed959c489b2e205a5c514d013b, UNASSIGN}] 2023-10-03 10:01:11,208 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24393e1104e3ef6b17043182475ebbea, UNASSIGN 2023-10-03 10:01:11,208 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=438b88ed959c489b2e205a5c514d013b, UNASSIGN 2023-10-03 10:01:11,209 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=438b88ed959c489b2e205a5c514d013b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:11,209 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=24393e1104e3ef6b17043182475ebbea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:11,209 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696327271209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327271209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327271209"}]},"ts":"1696327271209"} 2023-10-03 10:01:11,209 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696327271209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327271209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327271209"}]},"ts":"1696327271209"} 2023-10-03 10:01:11,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 438b88ed959c489b2e205a5c514d013b, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:01:11,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 24393e1104e3ef6b17043182475ebbea, server=jenkins-hbase4.apache.org,34139,1696327200029}] 2023-10-03 10:01:11,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-03 10:01:11,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 24393e1104e3ef6b17043182475ebbea 2023-10-03 10:01:11,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 24393e1104e3ef6b17043182475ebbea, disabling compactions & flushes 2023-10-03 10:01:11,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 438b88ed959c489b2e205a5c514d013b 2023-10-03 10:01:11,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:01:11,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:01:11,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 438b88ed959c489b2e205a5c514d013b, disabling compactions & flushes 2023-10-03 10:01:11,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. after waiting 0 ms 2023-10-03 10:01:11,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:01:11,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:01:11,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:01:11,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. after waiting 0 ms 2023-10-03 10:01:11,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:01:11,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:01:11,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:01:11,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:11,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:11,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea. 2023-10-03 10:01:11,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 24393e1104e3ef6b17043182475ebbea: 2023-10-03 10:01:11,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b. 2023-10-03 10:01:11,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 438b88ed959c489b2e205a5c514d013b: 2023-10-03 10:01:11,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 438b88ed959c489b2e205a5c514d013b 2023-10-03 10:01:11,376 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=438b88ed959c489b2e205a5c514d013b, regionState=CLOSED 2023-10-03 10:01:11,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 24393e1104e3ef6b17043182475ebbea 2023-10-03 10:01:11,376 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696327271376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327271376"}]},"ts":"1696327271376"} 2023-10-03 10:01:11,376 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=24393e1104e3ef6b17043182475ebbea, regionState=CLOSED 2023-10-03 10:01:11,376 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696327271376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327271376"}]},"ts":"1696327271376"} 2023-10-03 10:01:11,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-10-03 10:01:11,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 438b88ed959c489b2e205a5c514d013b, server=jenkins-hbase4.apache.org,36133,1696327199942 in 167 msec 2023-10-03 10:01:11,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-10-03 10:01:11,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 24393e1104e3ef6b17043182475ebbea, server=jenkins-hbase4.apache.org,34139,1696327200029 in 167 msec 2023-10-03 10:01:11,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=438b88ed959c489b2e205a5c514d013b, UNASSIGN in 173 msec 2023-10-03 10:01:11,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-03 10:01:11,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=24393e1104e3ef6b17043182475ebbea, UNASSIGN in 174 msec 2023-10-03 10:01:11,382 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327271382"}]},"ts":"1696327271382"} 2023-10-03 10:01:11,383 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-03 10:01:11,385 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-03 10:01:11,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 187 msec 2023-10-03 10:01:11,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-03 10:01:11,504 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-03 10:01:11,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-03 10:01:11,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-03 10:01:11,508 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-03 10:01:11,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-03 10:01:11,509 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-03 10:01:11,513 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-03 10:01:11,516 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea 2023-10-03 10:01:11,516 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b 2023-10-03 10:01:11,518 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/recovered.edits] 2023-10-03 10:01:11,518 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/recovered.edits] 2023-10-03 10:01:11,522 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-03 10:01:11,522 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-03 10:01:11,522 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-03 10:01:11,522 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-03 10:01:11,522 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-03 10:01:11,522 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-03 10:01:11,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-03 10:01:11,523 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/cf/660e434c9f5f443ba95dfdd0616c059a to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/cf/660e434c9f5f443ba95dfdd0616c059a 2023-10-03 10:01:11,523 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/cf/30d6c1d0be5441b6869a52c537faf302 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/cf/30d6c1d0be5441b6869a52c537faf302 2023-10-03 10:01:11,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-03 10:01:11,525 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-03 10:01:11,525 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-03 10:01:11,525 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-03 10:01:11,525 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-03 10:01:11,525 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:11,525 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:11,525 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:11,525 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:11,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-03 10:01:11,527 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea/recovered.edits/9.seqid 2023-10-03 10:01:11,527 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b/recovered.edits/9.seqid 2023-10-03 10:01:11,527 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/24393e1104e3ef6b17043182475ebbea 2023-10-03 10:01:11,527 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testConsecutiveExports/438b88ed959c489b2e205a5c514d013b 2023-10-03 10:01:11,528 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-03 10:01:11,528 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-03 10:01:11,529 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-03 10:01:11,532 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100303166e21786c4fb6a26732fc9c492b72 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100303166e21786c4fb6a26732fc9c492b72 2023-10-03 10:01:11,533 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310033c680c4f3c0c4e79ae9fa7a864825bf4 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310033c680c4f3c0c4e79ae9fa7a864825bf4 2023-10-03 10:01:11,534 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-03 10:01:11,536 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-03 10:01:11,539 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-03 10:01:11,542 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-03 10:01:11,543 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-03 10:01:11,543 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-03 10:01:11,543 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327271543"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:11,543 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327271543"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:11,545 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-03 10:01:11,545 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 24393e1104e3ef6b17043182475ebbea, NAME => 'testtb-testConsecutiveExports,,1696327240454.24393e1104e3ef6b17043182475ebbea.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 438b88ed959c489b2e205a5c514d013b, NAME => 'testtb-testConsecutiveExports,1,1696327240454.438b88ed959c489b2e205a5c514d013b.', STARTKEY => '1', ENDKEY => ''}] 2023-10-03 10:01:11,545 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-03 10:01:11,545 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696327271545"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:11,547 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-03 10:01:11,558 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-03 10:01:11,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 53 msec 2023-10-03 10:01:11,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-03 10:01:11,627 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-03 10:01:11,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-03 10:01:11,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-03 10:01:11,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-03 10:01:11,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-03 10:01:11,665 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=748 (was 760), OpenFileDescriptor=906 (was 940), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=240 (was 284), ProcessCount=168 (was 168), AvailableMemoryMB=7951 (was 8157) 2023-10-03 10:01:11,665 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-10-03 10:01:11,683 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=240, ProcessCount=168, AvailableMemoryMB=7950 2023-10-03 10:01:11,683 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-10-03 10:01:11,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-03 10:01:11,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:11,688 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-03 10:01:11,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-03 10:01:11,688 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-03 10:01:11,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-03 10:01:11,691 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:11,691 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:11,691 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526 empty. 2023-10-03 10:01:11,691 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984 empty. 2023-10-03 10:01:11,692 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:11,692 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:11,692 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-03 10:01:11,701 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-03 10:01:11,702 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9cc61755f6fe69ded3cf97dee28c9526, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:01:11,702 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6947ca870f1c4a978e84e703b7cc5984, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:01:11,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:11,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9cc61755f6fe69ded3cf97dee28c9526, disabling compactions & flushes 2023-10-03 10:01:11,710 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:11,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:11,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:11,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. after waiting 0 ms 2023-10-03 10:01:11,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:11,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 6947ca870f1c4a978e84e703b7cc5984, disabling compactions & flushes 2023-10-03 10:01:11,710 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:11,710 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:11,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9cc61755f6fe69ded3cf97dee28c9526: 2023-10-03 10:01:11,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:11,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. after waiting 0 ms 2023-10-03 10:01:11,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:11,710 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:11,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 6947ca870f1c4a978e84e703b7cc5984: 2023-10-03 10:01:11,712 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-03 10:01:11,713 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696327271713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327271713"}]},"ts":"1696327271713"} 2023-10-03 10:01:11,713 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696327271713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327271713"}]},"ts":"1696327271713"} 2023-10-03 10:01:11,719 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-03 10:01:11,719 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-03 10:01:11,720 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327271720"}]},"ts":"1696327271720"} 2023-10-03 10:01:11,721 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-03 10:01:11,724 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-03 10:01:11,725 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-03 10:01:11,725 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-03 10:01:11,725 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-03 10:01:11,725 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-03 10:01:11,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9cc61755f6fe69ded3cf97dee28c9526, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6947ca870f1c4a978e84e703b7cc5984, ASSIGN}] 2023-10-03 10:01:11,727 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9cc61755f6fe69ded3cf97dee28c9526, ASSIGN 2023-10-03 10:01:11,727 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6947ca870f1c4a978e84e703b7cc5984, ASSIGN 2023-10-03 10:01:11,727 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9cc61755f6fe69ded3cf97dee28c9526, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34139,1696327200029; forceNewPlan=false, retain=false 2023-10-03 10:01:11,728 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6947ca870f1c4a978e84e703b7cc5984, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36133,1696327199942; forceNewPlan=false, retain=false 2023-10-03 10:01:11,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-03 10:01:11,878 INFO [jenkins-hbase4:33857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-03 10:01:11,880 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6947ca870f1c4a978e84e703b7cc5984, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:11,880 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9cc61755f6fe69ded3cf97dee28c9526, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:11,881 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696327271880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327271880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327271880"}]},"ts":"1696327271880"} 2023-10-03 10:01:11,881 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696327271880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327271880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327271880"}]},"ts":"1696327271880"} 2023-10-03 10:01:11,882 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 6947ca870f1c4a978e84e703b7cc5984, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:01:11,883 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 9cc61755f6fe69ded3cf97dee28c9526, server=jenkins-hbase4.apache.org,34139,1696327200029}] 2023-10-03 10:01:11,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-03 10:01:12,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:12,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:12,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6947ca870f1c4a978e84e703b7cc5984, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.', STARTKEY => '1', ENDKEY => ''} 2023-10-03 10:01:12,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9cc61755f6fe69ded3cf97dee28c9526, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.', STARTKEY => '', ENDKEY => '1'} 2023-10-03 10:01:12,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. service=AccessControlService 2023-10-03 10:01:12,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. service=AccessControlService 2023-10-03 10:01:12,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:01:12,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:01:12,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:12,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:12,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:12,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:12,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:12,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:12,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:12,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:12,040 INFO [StoreOpener-9cc61755f6fe69ded3cf97dee28c9526-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:12,040 INFO [StoreOpener-6947ca870f1c4a978e84e703b7cc5984-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:12,042 DEBUG [StoreOpener-9cc61755f6fe69ded3cf97dee28c9526-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/cf 2023-10-03 10:01:12,042 DEBUG [StoreOpener-6947ca870f1c4a978e84e703b7cc5984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/cf 2023-10-03 10:01:12,042 DEBUG [StoreOpener-9cc61755f6fe69ded3cf97dee28c9526-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/cf 2023-10-03 10:01:12,042 DEBUG [StoreOpener-6947ca870f1c4a978e84e703b7cc5984-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/cf 2023-10-03 10:01:12,043 INFO [StoreOpener-6947ca870f1c4a978e84e703b7cc5984-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6947ca870f1c4a978e84e703b7cc5984 columnFamilyName cf 2023-10-03 10:01:12,043 INFO [StoreOpener-9cc61755f6fe69ded3cf97dee28c9526-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9cc61755f6fe69ded3cf97dee28c9526 columnFamilyName cf 2023-10-03 10:01:12,044 INFO [StoreOpener-9cc61755f6fe69ded3cf97dee28c9526-1] regionserver.HStore(310): Store=9cc61755f6fe69ded3cf97dee28c9526/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:01:12,044 INFO [StoreOpener-6947ca870f1c4a978e84e703b7cc5984-1] regionserver.HStore(310): Store=6947ca870f1c4a978e84e703b7cc5984/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:01:12,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:12,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:12,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:12,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:12,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:12,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:12,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:01:12,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:01:12,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9cc61755f6fe69ded3cf97dee28c9526; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66018364, jitterRate=-0.01624971628189087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:01:12,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6947ca870f1c4a978e84e703b7cc5984; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66451228, jitterRate=-0.009799540042877197}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:01:12,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9cc61755f6fe69ded3cf97dee28c9526: 2023-10-03 10:01:12,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6947ca870f1c4a978e84e703b7cc5984: 2023-10-03 10:01:12,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526., pid=61, masterSystemTime=1696327272034 2023-10-03 10:01:12,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984., pid=60, masterSystemTime=1696327272034 2023-10-03 10:01:12,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:12,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:12,055 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9cc61755f6fe69ded3cf97dee28c9526, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:12,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:12,056 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696327272055"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327272055"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327272055"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327272055"}]},"ts":"1696327272055"} 2023-10-03 10:01:12,056 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6947ca870f1c4a978e84e703b7cc5984, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,056 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696327272056"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327272056"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327272056"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327272056"}]},"ts":"1696327272056"} 2023-10-03 10:01:12,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-10-03 10:01:12,060 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 9cc61755f6fe69ded3cf97dee28c9526, server=jenkins-hbase4.apache.org,34139,1696327200029 in 174 msec 2023-10-03 10:01:12,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-03 10:01:12,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9cc61755f6fe69ded3cf97dee28c9526, ASSIGN in 335 msec 2023-10-03 10:01:12,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 6947ca870f1c4a978e84e703b7cc5984, server=jenkins-hbase4.apache.org,36133,1696327199942 in 177 msec 2023-10-03 10:01:12,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-03 10:01:12,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6947ca870f1c4a978e84e703b7cc5984, ASSIGN in 336 msec 2023-10-03 10:01:12,063 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-03 10:01:12,064 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327272064"}]},"ts":"1696327272064"} 2023-10-03 10:01:12,065 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-03 10:01:12,067 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-03 10:01:12,067 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-03 10:01:12,069 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-03 10:01:12,072 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:12,072 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:12,072 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:12,072 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:12,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:12,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:12,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:12,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:12,075 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 388 msec 2023-10-03 10:01:12,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-03 10:01:12,292 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-03 10:01:12,295 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,295 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:12,297 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:01:12,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-03 10:01:12,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327272315 (current time:1696327272315). 2023-10-03 10:01:12,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:01:12,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x0a9676af to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:12,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fd787d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:12,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:12,326 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:12,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a9676af to 127.0.0.1:56716 2023-10-03 10:01:12,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:12,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x245274cd to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:12,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dc85de6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:12,335 DEBUG [hconnection-0xeb280ac-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:12,336 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:12,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:12,342 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35114, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:12,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x245274cd to 127.0.0.1:56716 2023-10-03 10:01:12,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:12,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-03 10:01:12,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:01:12,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-03 10:01:12,346 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:01:12,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-03 10:01:12,348 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-03 10:01:12,349 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696327872349 2023-10-03 10:01:12,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-03 10:01:12,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,350 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:01:12,350 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:01:12,351 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-03 10:01:12,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-03 10:01:12,352 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-03 10:01:12,353 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-03 10:01:12,353 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696327872353 2023-10-03 10:01:12,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,361 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-03 10:01:12,362 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:12,363 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-03 10:01:12,363 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-03 10:01:12,363 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,363 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,364 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,364 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,364 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,364 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,365 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,365 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,365 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,365 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:01:12,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,366 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-03 10:01:12,366 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:12,366 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-03 10:01:12,366 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:12,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,368 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-03 10:01:12,368 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-03 10:01:12,368 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:12,367 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-03 10:01:12,369 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-03 10:01:12,369 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-03 10:01:12,369 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-03 10:01:12,368 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-03 10:01:12,369 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-03 10:01:12,369 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-03 10:01:12,369 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-03 10:01:12,370 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,370 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:12,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:12,372 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,372 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,372 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,372 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:12,372 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:12,372 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,372 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:12,372 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:12,372 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:12,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:12,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-03 10:01:12,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@781ed845[Count = 1] remaining members to acquire global barrier 2023-10-03 10:01:12,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:12,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:12,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:12,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:12,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:12,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-03 10:01:12,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@781ed845[Count = 0] remaining members to acquire global barrier 2023-10-03 10:01:12,376 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-03 10:01:12,376 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,377 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,377 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,377 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-03 10:01:12,377 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-03 10:01:12,377 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,377 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-03 10:01:12,377 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:01:12,377 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:12,377 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:12,377 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:12,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,378 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. started... 2023-10-03 10:01:12,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,377 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,378 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-03 10:01:12,379 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6947ca870f1c4a978e84e703b7cc5984: 2023-10-03 10:01:12,379 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,379 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:12,379 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:01:12,379 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:12,379 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:12,379 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:12,379 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. started... 2023-10-03 10:01:12,379 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9cc61755f6fe69ded3cf97dee28c9526: 2023-10-03 10:01:12,379 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,379 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:12,379 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:01:12,382 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-03 10:01:12,382 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:12,382 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,383 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:01:12,382 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-03 10:01:12,389 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. completed. 2023-10-03 10:01:12,389 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. completed. 2023-10-03 10:01:12,389 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:12,389 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-03 10:01:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:01:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-03 10:01:12,389 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:01:12,391 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-03 10:01:12,391 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-03 10:01:12,391 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:12,391 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,391 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-03 10:01:12,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:12,391 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:12,392 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,393 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-03 10:01:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34139,1696327200029': 2023-10-03 10:01:12,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-03 10:01:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36133,1696327199942': 2023-10-03 10:01:12,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-03 10:01:12,401 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-03 10:01:12,401 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:01:12,401 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:01:12,401 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,401 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:01:12,403 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,403 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:12,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:12,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,403 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:12,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,404 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:12,404 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:12,406 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,407 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,407 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,410 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,410 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,410 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,410 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,410 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:12,410 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,412 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,412 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,412 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,412 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,410 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,412 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:01:12,412 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,413 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,413 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,413 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,413 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,413 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-03 10:01:12,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-03 10:01:12,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,444 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696327272349Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696327272426 (+77 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696327272426Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696327272426Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696327272431 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696327272438 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696327272443 (+5 ms) 2023-10-03 10:01:12,446 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-03 10:01:12,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 96 msec 2023-10-03 10:01:12,450 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:12,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-03 10:01:12,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:01:12,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34139] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:01:12,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36133] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:01:12,458 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,458 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:12,458 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:01:12,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-03 10:01:12,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327272469 (current time:1696327272469). 2023-10-03 10:01:12,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:01:12,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x18673103 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:12,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18d017c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:12,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:12,479 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:12,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18673103 to 127.0.0.1:56716 2023-10-03 10:01:12,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:12,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x4dd32ee6 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:12,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c1de176, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:12,487 DEBUG [hconnection-0x74ebad1d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:12,489 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:12,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:12,493 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:12,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dd32ee6 to 127.0.0.1:56716 2023-10-03 10:01:12,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:12,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-03 10:01:12,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:01:12,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-03 10:01:12,498 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:01:12,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-03 10:01:12,501 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-03 10:01:12,501 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696327872501 2023-10-03 10:01:12,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-03 10:01:12,501 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,502 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:01:12,503 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:01:12,503 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-03 10:01:12,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-03 10:01:12,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-03 10:01:12,505 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-03 10:01:12,506 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696327872506 2023-10-03 10:01:12,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,514 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-03 10:01:12,514 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:12,515 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-03 10:01:12,515 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-03 10:01:12,516 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,516 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,517 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,517 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,517 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,517 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,518 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,518 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,518 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,518 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:01:12,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-03 10:01:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-03 10:01:12,520 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:12,520 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-03 10:01:12,521 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-03 10:01:12,521 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-03 10:01:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:12,521 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-03 10:01:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-03 10:01:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-03 10:01:12,521 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-03 10:01:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-03 10:01:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-03 10:01:12,525 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:12,526 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,526 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,526 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,526 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:12,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:12,526 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,526 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,526 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:12,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:12,526 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,526 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:12,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:12,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-03 10:01:12,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dedcf2e[Count = 1] remaining members to acquire global barrier 2023-10-03 10:01:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:12,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-03 10:01:12,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dedcf2e[Count = 0] remaining members to acquire global barrier 2023-10-03 10:01:12,530 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-03 10:01:12,531 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,532 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,532 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,532 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,532 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-03 10:01:12,532 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,532 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-03 10:01:12,532 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:12,532 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:12,532 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,532 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:01:12,532 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:12,532 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. started... 2023-10-03 10:01:12,532 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-03 10:01:12,532 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:01:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,533 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-03 10:01:12,533 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6947ca870f1c4a978e84e703b7cc5984 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-03 10:01:12,533 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:12,533 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:12,533 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:12,533 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. started... 2023-10-03 10:01:12,533 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9cc61755f6fe69ded3cf97dee28c9526 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-03 10:01:12,534 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-03 10:01:12,534 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:12,534 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-03 10:01:12,551 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231003321f8be35d7f4ddeba526e92a0ebd023 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231003321f8be35d7f4ddeba526e92a0ebd023 2023-10-03 10:01:12,551 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231003e41b7cbc2ab24ac2a8b4e5246b939175 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231003e41b7cbc2ab24ac2a8b4e5246b939175 2023-10-03 10:01:12,559 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/.tmp/cf/0226978ce0a84d81973546a4ac0e753a 2023-10-03 10:01:12,559 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/.tmp/cf/3685cc98549a4dce9a3a7938d2e5280c 2023-10-03 10:01:12,563 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/.tmp/cf/0226978ce0a84d81973546a4ac0e753a as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/cf/0226978ce0a84d81973546a4ac0e753a 2023-10-03 10:01:12,563 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/.tmp/cf/3685cc98549a4dce9a3a7938d2e5280c as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/cf/3685cc98549a4dce9a3a7938d2e5280c 2023-10-03 10:01:12,568 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/cf/3685cc98549a4dce9a3a7938d2e5280c, entries=5, sequenceid=6, filesize=5.8 K 2023-10-03 10:01:12,569 INFO [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 9cc61755f6fe69ded3cf97dee28c9526 in 36ms, sequenceid=6, compaction requested=false 2023-10-03 10:01:12,569 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-03 10:01:12,569 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/cf/0226978ce0a84d81973546a4ac0e753a, entries=45, sequenceid=6, filesize=13.2 K 2023-10-03 10:01:12,570 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9cc61755f6fe69ded3cf97dee28c9526: 2023-10-03 10:01:12,570 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,570 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:12,570 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/cf/3685cc98549a4dce9a3a7938d2e5280c] hfiles 2023-10-03 10:01:12,570 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/cf/3685cc98549a4dce9a3a7938d2e5280c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,571 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 6947ca870f1c4a978e84e703b7cc5984 in 38ms, sequenceid=6, compaction requested=false 2023-10-03 10:01:12,573 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6947ca870f1c4a978e84e703b7cc5984: 2023-10-03 10:01:12,573 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,573 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:12,573 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/cf/0226978ce0a84d81973546a4ac0e753a] hfiles 2023-10-03 10:01:12,573 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/cf/0226978ce0a84d81973546a4ac0e753a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,579 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. completed. 2023-10-03 10:01:12,579 DEBUG [rs(jenkins-hbase4.apache.org,34139,1696327200029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:12,579 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:12,579 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:12,579 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,580 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-03 10:01:12,580 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:01:12,580 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. completed. 2023-10-03 10:01:12,581 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:12,581 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:12,581 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:12,581 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,581 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-03 10:01:12,581 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:01:12,582 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-03 10:01:12,582 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,582 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:12,582 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-03 10:01:12,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:12,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:12,585 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,585 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-03 10:01:12,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:12,585 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:12,585 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-03 10:01:12,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:12,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:12,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34139,1696327200029': 2023-10-03 10:01:12,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-03 10:01:12,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:12,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:12,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:12,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:12,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:12,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36133,1696327199942': 2023-10-03 10:01:12,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-03 10:01:12,592 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-03 10:01:12,592 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:01:12,592 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:01:12,592 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,592 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:01:12,598 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,598 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:12,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:12,598 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,598 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,598 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,598 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,598 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:12,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,598 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,599 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:12,599 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,601 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:12,601 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,601 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,603 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:12,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-03 10:01:12,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:01:12,604 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:01:12,605 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,605 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,605 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,605 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:12,605 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,605 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,605 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,606 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,605 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:12,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:12,605 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:12,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:01:12,607 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:12,606 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,607 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:12,607 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:12,607 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:12,608 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,608 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:12,608 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:12,608 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,608 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231003321f8be35d7f4ddeba526e92a0ebd023, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231003e41b7cbc2ab24ac2a8b4e5246b939175] mob files 2023-10-03 10:01:12,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231003321f8be35d7f4ddeba526e92a0ebd023 2023-10-03 10:01:12,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231003e41b7cbc2ab24ac2a8b4e5246b939175 2023-10-03 10:01:12,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-03 10:01:12,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,634 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:12,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696327272501Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696327272614 (+113 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696327272615 (+1 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696327272615Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696327272618 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696327272625 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696327272633 (+8 ms) 2023-10-03 10:01:12,636 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-03 10:01:12,637 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 134 msec 2023-10-03 10:01:12,804 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:12,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-03 10:01:12,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:01:12,833 DEBUG [Listener at jenkins-hbase4.apache.org/39739] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-03 10:01:12,838 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-03 10:01:12,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34139] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-03 10:01:12,840 DEBUG [Listener at jenkins-hbase4.apache.org/39739] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-03 10:01:12,844 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-03 10:01:12,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36133] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-03 10:01:12,844 DEBUG [Listener at jenkins-hbase4.apache.org/39739] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-03 10:01:12,847 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-03 10:01:12,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42977] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-03 10:01:12,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-03 10:01:12,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:12,851 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-03 10:01:12,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-03 10:01:12,852 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-03 10:01:12,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-03 10:01:12,854 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:12,854 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:12,855 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f empty. 2023-10-03 10:01:12,855 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630 empty. 2023-10-03 10:01:12,855 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:12,855 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:12,855 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-03 10:01:12,866 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-03 10:01:12,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => dab4cd62f8296ffaddad2fee3a68166f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:01:12,868 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1b680c4d2c78a661a4ac340ae9f8e630, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:01:12,877 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:12,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 1b680c4d2c78a661a4ac340ae9f8e630, disabling compactions & flushes 2023-10-03 10:01:12,878 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:12,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:12,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. after waiting 0 ms 2023-10-03 10:01:12,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:12,878 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:12,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 1b680c4d2c78a661a4ac340ae9f8e630: 2023-10-03 10:01:12,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:12,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing dab4cd62f8296ffaddad2fee3a68166f, disabling compactions & flushes 2023-10-03 10:01:12,884 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:12,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:12,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. after waiting 0 ms 2023-10-03 10:01:12,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:12,884 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:12,884 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for dab4cd62f8296ffaddad2fee3a68166f: 2023-10-03 10:01:12,886 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-03 10:01:12,887 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696327272887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327272887"}]},"ts":"1696327272887"} 2023-10-03 10:01:12,887 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696327272887"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327272887"}]},"ts":"1696327272887"} 2023-10-03 10:01:12,889 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-03 10:01:12,890 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-03 10:01:12,890 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327272890"}]},"ts":"1696327272890"} 2023-10-03 10:01:12,891 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-03 10:01:12,894 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-03 10:01:12,895 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-03 10:01:12,895 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-03 10:01:12,895 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-03 10:01:12,895 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-03 10:01:12,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab4cd62f8296ffaddad2fee3a68166f, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b680c4d2c78a661a4ac340ae9f8e630, ASSIGN}] 2023-10-03 10:01:12,898 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b680c4d2c78a661a4ac340ae9f8e630, ASSIGN 2023-10-03 10:01:12,898 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab4cd62f8296ffaddad2fee3a68166f, ASSIGN 2023-10-03 10:01:12,898 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b680c4d2c78a661a4ac340ae9f8e630, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36133,1696327199942; forceNewPlan=false, retain=false 2023-10-03 10:01:12,898 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab4cd62f8296ffaddad2fee3a68166f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42977,1696327199993; forceNewPlan=false, retain=false 2023-10-03 10:01:12,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-03 10:01:13,049 INFO [jenkins-hbase4:33857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-03 10:01:13,051 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=1b680c4d2c78a661a4ac340ae9f8e630, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:13,051 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=dab4cd62f8296ffaddad2fee3a68166f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:13,052 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696327273051"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327273051"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327273051"}]},"ts":"1696327273051"} 2023-10-03 10:01:13,052 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696327273051"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327273051"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327273051"}]},"ts":"1696327273051"} 2023-10-03 10:01:13,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 1b680c4d2c78a661a4ac340ae9f8e630, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:01:13,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure dab4cd62f8296ffaddad2fee3a68166f, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:01:13,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-03 10:01:13,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:13,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b680c4d2c78a661a4ac340ae9f8e630, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630.', STARTKEY => '2', ENDKEY => ''} 2023-10-03 10:01:13,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:13,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dab4cd62f8296ffaddad2fee3a68166f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f.', STARTKEY => '', ENDKEY => '2'} 2023-10-03 10:01:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. service=AccessControlService 2023-10-03 10:01:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. service=AccessControlService 2023-10-03 10:01:13,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:01:13,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:01:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:13,215 INFO [StoreOpener-dab4cd62f8296ffaddad2fee3a68166f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:13,215 INFO [StoreOpener-1b680c4d2c78a661a4ac340ae9f8e630-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:13,216 DEBUG [StoreOpener-1b680c4d2c78a661a4ac340ae9f8e630-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/cf 2023-10-03 10:01:13,216 DEBUG [StoreOpener-dab4cd62f8296ffaddad2fee3a68166f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/cf 2023-10-03 10:01:13,216 DEBUG [StoreOpener-1b680c4d2c78a661a4ac340ae9f8e630-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/cf 2023-10-03 10:01:13,216 DEBUG [StoreOpener-dab4cd62f8296ffaddad2fee3a68166f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/cf 2023-10-03 10:01:13,217 INFO [StoreOpener-1b680c4d2c78a661a4ac340ae9f8e630-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b680c4d2c78a661a4ac340ae9f8e630 columnFamilyName cf 2023-10-03 10:01:13,217 INFO [StoreOpener-dab4cd62f8296ffaddad2fee3a68166f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dab4cd62f8296ffaddad2fee3a68166f columnFamilyName cf 2023-10-03 10:01:13,217 INFO [StoreOpener-1b680c4d2c78a661a4ac340ae9f8e630-1] regionserver.HStore(310): Store=1b680c4d2c78a661a4ac340ae9f8e630/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:01:13,217 INFO [StoreOpener-dab4cd62f8296ffaddad2fee3a68166f-1] regionserver.HStore(310): Store=dab4cd62f8296ffaddad2fee3a68166f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:01:13,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:13,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:13,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:13,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:13,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:13,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:13,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:01:13,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:01:13,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b680c4d2c78a661a4ac340ae9f8e630; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64560372, jitterRate=-0.0379754900932312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:01:13,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dab4cd62f8296ffaddad2fee3a68166f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67661392, jitterRate=0.008233308792114258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:01:13,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b680c4d2c78a661a4ac340ae9f8e630: 2023-10-03 10:01:13,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dab4cd62f8296ffaddad2fee3a68166f: 2023-10-03 10:01:13,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f., pid=70, masterSystemTime=1696327273206 2023-10-03 10:01:13,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630., pid=69, masterSystemTime=1696327273205 2023-10-03 10:01:13,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:13,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:13,227 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=1b680c4d2c78a661a4ac340ae9f8e630, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:13,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:13,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:13,227 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696327273227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327273227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327273227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327273227"}]},"ts":"1696327273227"} 2023-10-03 10:01:13,228 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=dab4cd62f8296ffaddad2fee3a68166f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:13,228 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696327273227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327273227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327273227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327273227"}]},"ts":"1696327273227"} 2023-10-03 10:01:13,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-03 10:01:13,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 1b680c4d2c78a661a4ac340ae9f8e630, server=jenkins-hbase4.apache.org,36133,1696327199942 in 176 msec 2023-10-03 10:01:13,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-03 10:01:13,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure dab4cd62f8296ffaddad2fee3a68166f, server=jenkins-hbase4.apache.org,42977,1696327199993 in 175 msec 2023-10-03 10:01:13,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b680c4d2c78a661a4ac340ae9f8e630, ASSIGN in 335 msec 2023-10-03 10:01:13,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-03 10:01:13,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab4cd62f8296ffaddad2fee3a68166f, ASSIGN in 336 msec 2023-10-03 10:01:13,234 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-03 10:01:13,234 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327273234"}]},"ts":"1696327273234"} 2023-10-03 10:01:13,235 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-03 10:01:13,237 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-03 10:01:13,238 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-03 10:01:13,239 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-03 10:01:13,242 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:13,242 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:13,242 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:13,242 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:13,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:13,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:13,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:13,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:13,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:13,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:13,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:13,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:13,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 394 msec 2023-10-03 10:01:13,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-03 10:01:13,456 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-03 10:01:13,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions dab4cd62f8296ffaddad2fee3a68166f, 1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:13,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dab4cd62f8296ffaddad2fee3a68166f, 1b680c4d2c78a661a4ac340ae9f8e630], force=true 2023-10-03 10:01:13,488 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dab4cd62f8296ffaddad2fee3a68166f, 1b680c4d2c78a661a4ac340ae9f8e630], force=true 2023-10-03 10:01:13,488 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dab4cd62f8296ffaddad2fee3a68166f, 1b680c4d2c78a661a4ac340ae9f8e630], force=true 2023-10-03 10:01:13,488 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dab4cd62f8296ffaddad2fee3a68166f, 1b680c4d2c78a661a4ac340ae9f8e630], force=true 2023-10-03 10:01:13,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-03 10:01:13,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab4cd62f8296ffaddad2fee3a68166f, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b680c4d2c78a661a4ac340ae9f8e630, UNASSIGN}] 2023-10-03 10:01:13,512 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab4cd62f8296ffaddad2fee3a68166f, UNASSIGN 2023-10-03 10:01:13,512 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b680c4d2c78a661a4ac340ae9f8e630, UNASSIGN 2023-10-03 10:01:13,513 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=dab4cd62f8296ffaddad2fee3a68166f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:13,513 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=1b680c4d2c78a661a4ac340ae9f8e630, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:13,513 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696327273513"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327273513"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327273513"}]},"ts":"1696327273513"} 2023-10-03 10:01:13,513 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696327273513"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327273513"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327273513"}]},"ts":"1696327273513"} 2023-10-03 10:01:13,515 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure dab4cd62f8296ffaddad2fee3a68166f, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:01:13,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 1b680c4d2c78a661a4ac340ae9f8e630, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:01:13,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-03 10:01:13,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:13,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dab4cd62f8296ffaddad2fee3a68166f, disabling compactions & flushes 2023-10-03 10:01:13,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:13,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:13,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. after waiting 0 ms 2023-10-03 10:01:13,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:13,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing dab4cd62f8296ffaddad2fee3a68166f 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-03 10:01:13,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:13,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b680c4d2c78a661a4ac340ae9f8e630, disabling compactions & flushes 2023-10-03 10:01:13,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:13,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:13,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. after waiting 0 ms 2023-10-03 10:01:13,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:13,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1b680c4d2c78a661a4ac340ae9f8e630 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-03 10:01:13,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/.tmp/cf/40581ac4b2e44c53a0174fef40ea946c 2023-10-03 10:01:13,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/.tmp/cf/e3b7ce10249c4279adefd62f467704a9 2023-10-03 10:01:13,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/.tmp/cf/40581ac4b2e44c53a0174fef40ea946c as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/cf/40581ac4b2e44c53a0174fef40ea946c 2023-10-03 10:01:13,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/.tmp/cf/e3b7ce10249c4279adefd62f467704a9 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/cf/e3b7ce10249c4279adefd62f467704a9 2023-10-03 10:01:13,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/cf/e3b7ce10249c4279adefd62f467704a9, entries=1, sequenceid=5, filesize=4.7 K 2023-10-03 10:01:13,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/cf/40581ac4b2e44c53a0174fef40ea946c, entries=1, sequenceid=5, filesize=4.7 K 2023-10-03 10:01:13,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1b680c4d2c78a661a4ac340ae9f8e630 in 22ms, sequenceid=5, compaction requested=false 2023-10-03 10:01:13,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-03 10:01:13,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for dab4cd62f8296ffaddad2fee3a68166f in 23ms, sequenceid=5, compaction requested=false 2023-10-03 10:01:13,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-03 10:01:13,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-03 10:01:13,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-03 10:01:13,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:13,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:13,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630. 2023-10-03 10:01:13,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f. 2023-10-03 10:01:13,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b680c4d2c78a661a4ac340ae9f8e630: 2023-10-03 10:01:13,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dab4cd62f8296ffaddad2fee3a68166f: 2023-10-03 10:01:13,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:13,706 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=1b680c4d2c78a661a4ac340ae9f8e630, regionState=CLOSED 2023-10-03 10:01:13,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:13,706 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696327273706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327273706"}]},"ts":"1696327273706"} 2023-10-03 10:01:13,706 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=dab4cd62f8296ffaddad2fee3a68166f, regionState=CLOSED 2023-10-03 10:01:13,707 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696327273706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327273706"}]},"ts":"1696327273706"} 2023-10-03 10:01:13,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-03 10:01:13,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 1b680c4d2c78a661a4ac340ae9f8e630, server=jenkins-hbase4.apache.org,36133,1696327199942 in 191 msec 2023-10-03 10:01:13,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b680c4d2c78a661a4ac340ae9f8e630, UNASSIGN in 198 msec 2023-10-03 10:01:13,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-03 10:01:13,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure dab4cd62f8296ffaddad2fee3a68166f, server=jenkins-hbase4.apache.org,42977,1696327199993 in 194 msec 2023-10-03 10:01:13,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-03 10:01:13,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dab4cd62f8296ffaddad2fee3a68166f, UNASSIGN in 203 msec 2023-10-03 10:01:13,755 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-03 10:01:13,757 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272848.dab4cd62f8296ffaddad2fee3a68166f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:13,757 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696327272848.1b680c4d2c78a661a4ac340ae9f8e630.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:13,757 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:13,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-03 10:01:13,806 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccda06847740b03049051d9adc9b4d20, ASSIGN}] 2023-10-03 10:01:13,807 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccda06847740b03049051d9adc9b4d20, ASSIGN 2023-10-03 10:01:13,807 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccda06847740b03049051d9adc9b4d20, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42977,1696327199993; forceNewPlan=false, retain=false 2023-10-03 10:01:13,957 INFO [jenkins-hbase4:33857] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-03 10:01:13,959 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ccda06847740b03049051d9adc9b4d20, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:13,960 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696327273959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327273959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327273959"}]},"ts":"1696327273959"} 2023-10-03 10:01:13,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure ccda06847740b03049051d9adc9b4d20, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:01:14,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-03 10:01:14,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. 2023-10-03 10:01:14,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ccda06847740b03049051d9adc9b4d20, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.', STARTKEY => '', ENDKEY => ''} 2023-10-03 10:01:14,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. service=AccessControlService 2023-10-03 10:01:14,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:01:14,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:14,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:14,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:14,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:14,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/.regioninfo 2023-10-03 10:01:14,126 INFO [StoreOpener-ccda06847740b03049051d9adc9b4d20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:14,127 DEBUG [StoreOpener-ccda06847740b03049051d9adc9b4d20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf 2023-10-03 10:01:14,127 DEBUG [StoreOpener-ccda06847740b03049051d9adc9b4d20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf 2023-10-03 10:01:14,128 INFO [StoreOpener-ccda06847740b03049051d9adc9b4d20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccda06847740b03049051d9adc9b4d20 columnFamilyName cf 2023-10-03 10:01:14,154 DEBUG [StoreOpener-ccda06847740b03049051d9adc9b4d20-1] regionserver.HStore(539): loaded hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf/40581ac4b2e44c53a0174fef40ea946c.dab4cd62f8296ffaddad2fee3a68166f->hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/cf/40581ac4b2e44c53a0174fef40ea946c-top 2023-10-03 10:01:14,158 DEBUG [StoreOpener-ccda06847740b03049051d9adc9b4d20-1] regionserver.HStore(539): loaded hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf/e3b7ce10249c4279adefd62f467704a9.1b680c4d2c78a661a4ac340ae9f8e630->hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/cf/e3b7ce10249c4279adefd62f467704a9-top 2023-10-03 10:01:14,159 INFO [StoreOpener-ccda06847740b03049051d9adc9b4d20-1] regionserver.HStore(310): Store=ccda06847740b03049051d9adc9b4d20/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:01:14,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:14,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:14,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:14,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ccda06847740b03049051d9adc9b4d20; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63212315, jitterRate=-0.05806310474872589}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:01:14,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ccda06847740b03049051d9adc9b4d20: 2023-10-03 10:01:14,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20., pid=77, masterSystemTime=1696327274113 2023-10-03 10:01:14,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.,because compaction is disabled. 2023-10-03 10:01:14,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. 2023-10-03 10:01:14,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. 2023-10-03 10:01:14,168 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ccda06847740b03049051d9adc9b4d20, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,168 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696327274167"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327274167"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327274167"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327274167"}]},"ts":"1696327274167"} 2023-10-03 10:01:14,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-03 10:01:14,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure ccda06847740b03049051d9adc9b4d20, server=jenkins-hbase4.apache.org,42977,1696327199993 in 208 msec 2023-10-03 10:01:14,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-03 10:01:14,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccda06847740b03049051d9adc9b4d20, ASSIGN in 365 msec 2023-10-03 10:01:14,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[dab4cd62f8296ffaddad2fee3a68166f, 1b680c4d2c78a661a4ac340ae9f8e630], force=true in 692 msec 2023-10-03 10:01:14,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-03 10:01:14,596 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-03 10:01:14,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-03 10:01:14,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327274597 (current time:1696327274597). 2023-10-03 10:01:14,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:01:14,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x799160b2 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:14,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3abb87a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:14,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:14,608 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:14,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x799160b2 to 127.0.0.1:56716 2023-10-03 10:01:14,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:14,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x21c7c3a7 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:14,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5321a3dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:14,617 DEBUG [hconnection-0x35c1a097-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:14,619 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:14,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:14,625 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:14,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21c7c3a7 to 127.0.0.1:56716 2023-10-03 10:01:14,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:14,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-03 10:01:14,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:01:14,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-03 10:01:14,629 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:01:14,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-03 10:01:14,631 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-03 10:01:14,632 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696327874632 2023-10-03 10:01:14,632 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-03 10:01:14,636 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:01:14,636 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:01:14,637 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-03 10:01:14,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-03 10:01:14,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-03 10:01:14,638 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-03 10:01:14,639 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696327874639 2023-10-03 10:01:14,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,647 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-03 10:01:14,648 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:14,649 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-03 10:01:14,649 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-03 10:01:14,649 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,649 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,651 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:14,651 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:14,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:14,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:14,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:14,651 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:14,651 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:14,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:14,651 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:14,651 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:01:14,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-03 10:01:14,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-03 10:01:14,652 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-03 10:01:14,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,653 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-03 10:01:14,653 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-03 10:01:14,653 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:14,654 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-03 10:01:14,654 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,654 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-03 10:01:14,654 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-03 10:01:14,654 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:14,654 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-03 10:01:14,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-03 10:01:14,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,655 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-03 10:01:14,655 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-03 10:01:14,655 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-03 10:01:14,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-03 10:01:14,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,656 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-03 10:01:14,656 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:14,657 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-03 10:01:14,657 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-03 10:01:14,657 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-03 10:01:14,658 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,660 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,660 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,660 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:14,661 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,661 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,661 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,661 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:14,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:14,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:14,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:14,661 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,662 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:14,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:14,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:14,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:14,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:14,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-03 10:01:14,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a41043b[Count = 0] remaining members to acquire global barrier 2023-10-03 10:01:14,664 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-03 10:01:14,664 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,665 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,665 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,665 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,665 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-03 10:01:14,665 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-03 10:01:14,666 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-03 10:01:14,665 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,666 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:14,666 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:14,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,666 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. 2023-10-03 10:01:14,666 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:01:14,666 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. started... 2023-10-03 10:01:14,666 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:01:14,666 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-03 10:01:14,666 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-03 10:01:14,667 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:01:14,667 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ccda06847740b03049051d9adc9b4d20: 2023-10-03 10:01:14,668 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,668 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:14,668 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf/40581ac4b2e44c53a0174fef40ea946c.dab4cd62f8296ffaddad2fee3a68166f->hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/cf/40581ac4b2e44c53a0174fef40ea946c-top, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf/e3b7ce10249c4279adefd62f467704a9.1b680c4d2c78a661a4ac340ae9f8e630->hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/cf/e3b7ce10249c4279adefd62f467704a9-top] hfiles 2023-10-03 10:01:14,668 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf/40581ac4b2e44c53a0174fef40ea946c.dab4cd62f8296ffaddad2fee3a68166f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,669 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf/e3b7ce10249c4279adefd62f467704a9.1b680c4d2c78a661a4ac340ae9f8e630 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,669 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-03 10:01:14,669 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:14,669 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-03 10:01:14,670 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-03 10:01:14,670 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:14,670 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-03 10:01:14,680 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. completed. 2023-10-03 10:01:14,680 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. 2023-10-03 10:01:14,680 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:14,680 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:14,680 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,680 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-03 10:01:14,680 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:01:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-03 10:01:14,685 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:14,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:14,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-03 10:01:14,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:14,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:14,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:14,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:14,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:14,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:14,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:14,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,42977,1696327199993': 2023-10-03 10:01:14,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-03 10:01:14,688 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-03 10:01:14,688 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:01:14,688 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:01:14,688 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,688 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:01:14,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:14,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:14,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:14,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:14,691 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:14,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:14,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:14,691 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:14,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:14,691 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:14,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:14,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:14,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:14,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:14,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:14,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:14,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:14,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,693 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:14,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:14,694 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:14,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,694 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:14,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:14,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,701 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:14,701 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:14,701 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:14,701 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:14,701 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,701 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,701 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:14,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:14,702 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:14,701 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:14,701 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:14,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:14,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:14,702 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:14,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:14,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,701 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:14,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:14,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:14,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:14,702 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:14,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:14,702 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:14,702 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,703 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:14,703 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:14,703 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,703 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:14,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:14,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,723 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-03 10:01:14,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,724 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696327274632Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696327274701 (+69 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696327274702 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696327274706 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696327274716 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696327274723 (+7 ms) 2023-10-03 10:01:14,727 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-03 10:01:14,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 92 msec 2023-10-03 10:01:14,736 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:14,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-03 10:01:14,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:01:14,737 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327274737 2023-10-03 10:01:14,738 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36071, tgtDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327274737, rawTgtDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327274737, srcFsUri=hdfs://localhost:36071, srcDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:01:14,759 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:01:14,759 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1376717285_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327274737, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327274737/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,759 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead, snapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-03 10:01:14,771 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327274737/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:14,786 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,786 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,787 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,787 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,787 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,788 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,788 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,857 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop-5951128737034182331.jar 2023-10-03 10:01:14,857 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,858 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,858 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,858 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,859 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,859 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:14,859 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-03 10:01:14,860 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-03 10:01:14,860 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-03 10:01:14,860 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-03 10:01:14,861 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-03 10:01:14,861 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-03 10:01:14,862 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-03 10:01:14,862 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-03 10:01:14,862 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-03 10:01:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-03 10:01:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:14,863 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:14,864 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:01:14,864 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:14,864 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:14,864 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:01:14,865 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:01:15,211 WARN [Listener at jenkins-hbase4.apache.org/39739] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-03 10:01:15,213 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-03 10:01:15,215 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-03 10:01:15,518 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:01:15,518 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:01:15,522 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0004_000001 (auth:SIMPLE) 2023-10-03 10:01:16,492 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0005_000001 (auth:SIMPLE) 2023-10-03 10:01:16,949 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-03 10:01:20,140 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0005_000001 (auth:SIMPLE) 2023-10-03 10:01:22,346 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0005_000001 (auth:SIMPLE) 2023-10-03 10:01:24,673 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0005_000001 (auth:SIMPLE) 2023-10-03 10:01:26,379 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-03 10:01:26,382 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-03 10:01:26,390 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,391 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-03 10:01:26,391 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-03 10:01:26,391 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,392 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-03 10:01:26,392 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-03 10:01:26,392 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327274737/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327274737/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,393 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327274737/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-03 10:01:26,393 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327274737/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-03 10:01:26,399 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-03 10:01:26,403 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327286403"}]},"ts":"1696327286403"} 2023-10-03 10:01:26,404 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-03 10:01:26,406 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-03 10:01:26,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccda06847740b03049051d9adc9b4d20, UNASSIGN}] 2023-10-03 10:01:26,408 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccda06847740b03049051d9adc9b4d20, UNASSIGN 2023-10-03 10:01:26,409 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ccda06847740b03049051d9adc9b4d20, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:26,409 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696327286409"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327286409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327286409"}]},"ts":"1696327286409"} 2023-10-03 10:01:26,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure ccda06847740b03049051d9adc9b4d20, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:01:26,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-03 10:01:26,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:26,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ccda06847740b03049051d9adc9b4d20, disabling compactions & flushes 2023-10-03 10:01:26,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. 2023-10-03 10:01:26,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. 2023-10-03 10:01:26,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. after waiting 0 ms 2023-10-03 10:01:26,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. 2023-10-03 10:01:26,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-03 10:01:26,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:26,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20. 2023-10-03 10:01:26,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ccda06847740b03049051d9adc9b4d20: 2023-10-03 10:01:26,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:26,576 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ccda06847740b03049051d9adc9b4d20, regionState=CLOSED 2023-10-03 10:01:26,576 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696327286576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327286576"}]},"ts":"1696327286576"} 2023-10-03 10:01:26,578 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-03 10:01:26,578 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure ccda06847740b03049051d9adc9b4d20, server=jenkins-hbase4.apache.org,42977,1696327199993 in 167 msec 2023-10-03 10:01:26,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-03 10:01:26,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ccda06847740b03049051d9adc9b4d20, UNASSIGN in 172 msec 2023-10-03 10:01:26,580 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327286580"}]},"ts":"1696327286580"} 2023-10-03 10:01:26,581 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-03 10:01:26,583 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-03 10:01:26,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 184 msec 2023-10-03 10:01:26,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-03 10:01:26,705 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-03 10:01:26,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,709 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,710 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,711 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,715 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,715 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,715 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,715 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:26,715 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:26,715 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,715 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:26,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-03 10:01:26,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-03 10:01:26,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-03 10:01:26,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-03 10:01:26,717 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,717 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,717 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,717 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:26,717 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:26,717 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:26,717 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,717 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:26,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:26,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:26,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-03 10:01:26,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:26,719 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:26,719 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/recovered.edits] 2023-10-03 10:01:26,719 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/recovered.edits] 2023-10-03 10:01:26,719 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/recovered.edits] 2023-10-03 10:01:26,723 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/cf/40581ac4b2e44c53a0174fef40ea946c to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/cf/40581ac4b2e44c53a0174fef40ea946c 2023-10-03 10:01:26,723 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf/40581ac4b2e44c53a0174fef40ea946c.dab4cd62f8296ffaddad2fee3a68166f to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf/40581ac4b2e44c53a0174fef40ea946c.dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:26,724 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/cf/e3b7ce10249c4279adefd62f467704a9 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/cf/e3b7ce10249c4279adefd62f467704a9 2023-10-03 10:01:26,725 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf/e3b7ce10249c4279adefd62f467704a9.1b680c4d2c78a661a4ac340ae9f8e630 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/cf/e3b7ce10249c4279adefd62f467704a9.1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:26,727 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/recovered.edits/8.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f/recovered.edits/8.seqid 2023-10-03 10:01:26,728 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/recovered.edits/8.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630/recovered.edits/8.seqid 2023-10-03 10:01:26,728 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dab4cd62f8296ffaddad2fee3a68166f 2023-10-03 10:01:26,728 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b680c4d2c78a661a4ac340ae9f8e630 2023-10-03 10:01:26,729 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/recovered.edits/12.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20/recovered.edits/12.seqid 2023-10-03 10:01:26,730 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ccda06847740b03049051d9adc9b4d20 2023-10-03 10:01:26,730 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-03 10:01:26,732 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,735 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-03 10:01:26,737 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-03 10:01:26,738 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,738 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-03 10:01:26,738 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327286738"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:26,740 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-03 10:01:26,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ccda06847740b03049051d9adc9b4d20, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696327272849.ccda06847740b03049051d9adc9b4d20.', STARTKEY => '', ENDKEY => ''}] 2023-10-03 10:01:26,740 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-03 10:01:26,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696327286740"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:26,741 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-03 10:01:26,743 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:26,744 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 37 msec 2023-10-03 10:01:26,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-03 10:01:26,820 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-03 10:01:26,820 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:26,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:26,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:26,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-03 10:01:26,825 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327286825"}]},"ts":"1696327286825"} 2023-10-03 10:01:26,827 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-03 10:01:26,828 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-03 10:01:26,829 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9cc61755f6fe69ded3cf97dee28c9526, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6947ca870f1c4a978e84e703b7cc5984, UNASSIGN}] 2023-10-03 10:01:26,831 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9cc61755f6fe69ded3cf97dee28c9526, UNASSIGN 2023-10-03 10:01:26,831 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6947ca870f1c4a978e84e703b7cc5984, UNASSIGN 2023-10-03 10:01:26,832 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9cc61755f6fe69ded3cf97dee28c9526, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:26,832 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696327286831"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327286831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327286831"}]},"ts":"1696327286831"} 2023-10-03 10:01:26,832 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6947ca870f1c4a978e84e703b7cc5984, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:26,832 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696327286832"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327286832"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327286832"}]},"ts":"1696327286832"} 2023-10-03 10:01:26,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 9cc61755f6fe69ded3cf97dee28c9526, server=jenkins-hbase4.apache.org,34139,1696327200029}] 2023-10-03 10:01:26,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 6947ca870f1c4a978e84e703b7cc5984, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:01:26,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-03 10:01:26,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:26,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:26,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9cc61755f6fe69ded3cf97dee28c9526, disabling compactions & flushes 2023-10-03 10:01:26,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6947ca870f1c4a978e84e703b7cc5984, disabling compactions & flushes 2023-10-03 10:01:26,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:26,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:26,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:26,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:26,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. after waiting 0 ms 2023-10-03 10:01:26,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:26,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. after waiting 0 ms 2023-10-03 10:01:26,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:26,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:01:26,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:01:26,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:26,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:26,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984. 2023-10-03 10:01:26,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526. 2023-10-03 10:01:26,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6947ca870f1c4a978e84e703b7cc5984: 2023-10-03 10:01:26,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9cc61755f6fe69ded3cf97dee28c9526: 2023-10-03 10:01:27,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:27,001 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6947ca870f1c4a978e84e703b7cc5984, regionState=CLOSED 2023-10-03 10:01:27,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:27,001 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696327287001"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327287001"}]},"ts":"1696327287001"} 2023-10-03 10:01:27,001 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9cc61755f6fe69ded3cf97dee28c9526, regionState=CLOSED 2023-10-03 10:01:27,001 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696327287001"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327287001"}]},"ts":"1696327287001"} 2023-10-03 10:01:27,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-03 10:01:27,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 6947ca870f1c4a978e84e703b7cc5984, server=jenkins-hbase4.apache.org,36133,1696327199942 in 168 msec 2023-10-03 10:01:27,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-03 10:01:27,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 9cc61755f6fe69ded3cf97dee28c9526, server=jenkins-hbase4.apache.org,34139,1696327200029 in 170 msec 2023-10-03 10:01:27,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6947ca870f1c4a978e84e703b7cc5984, UNASSIGN in 175 msec 2023-10-03 10:01:27,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-10-03 10:01:27,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9cc61755f6fe69ded3cf97dee28c9526, UNASSIGN in 175 msec 2023-10-03 10:01:27,006 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327287006"}]},"ts":"1696327287006"} 2023-10-03 10:01:27,007 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-03 10:01:27,010 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-03 10:01:27,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 189 msec 2023-10-03 10:01:27,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-03 10:01:27,127 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-03 10:01:27,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,131 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,131 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,133 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,135 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,135 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,135 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,135 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,136 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:27,136 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:27,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-03 10:01:27,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-03 10:01:27,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-03 10:01:27,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-03 10:01:27,137 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,137 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,137 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,137 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,137 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:27,137 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:27,137 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:27,137 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:27,138 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/recovered.edits] 2023-10-03 10:01:27,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-03 10:01:27,138 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/recovered.edits] 2023-10-03 10:01:27,142 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/cf/0226978ce0a84d81973546a4ac0e753a to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/cf/0226978ce0a84d81973546a4ac0e753a 2023-10-03 10:01:27,143 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/cf/3685cc98549a4dce9a3a7938d2e5280c to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/cf/3685cc98549a4dce9a3a7938d2e5280c 2023-10-03 10:01:27,145 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984/recovered.edits/9.seqid 2023-10-03 10:01:27,145 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6947ca870f1c4a978e84e703b7cc5984 2023-10-03 10:01:27,146 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526/recovered.edits/9.seqid 2023-10-03 10:01:27,146 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9cc61755f6fe69ded3cf97dee28c9526 2023-10-03 10:01:27,146 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-03 10:01:27,146 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-03 10:01:27,147 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-03 10:01:27,150 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231003321f8be35d7f4ddeba526e92a0ebd023 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231003321f8be35d7f4ddeba526e92a0ebd023 2023-10-03 10:01:27,151 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231003e41b7cbc2ab24ac2a8b4e5246b939175 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231003e41b7cbc2ab24ac2a8b4e5246b939175 2023-10-03 10:01:27,152 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-03 10:01:27,154 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,156 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-03 10:01:27,157 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-03 10:01:27,158 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,158 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-03 10:01:27,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327287158"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:27,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327287158"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:27,160 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-03 10:01:27,160 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9cc61755f6fe69ded3cf97dee28c9526, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696327271684.9cc61755f6fe69ded3cf97dee28c9526.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6947ca870f1c4a978e84e703b7cc5984, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696327271684.6947ca870f1c4a978e84e703b7cc5984.', STARTKEY => '1', ENDKEY => ''}] 2023-10-03 10:01:27,160 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-03 10:01:27,160 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696327287160"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:27,162 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-03 10:01:27,165 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 37 msec 2023-10-03 10:01:27,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-03 10:01:27,239 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-03 10:01:27,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-03 10:01:27,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-03 10:01:27,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-03 10:01:27,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-03 10:01:27,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-03 10:01:27,281 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 748) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:38659 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4072 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-253479737_1 at /127.0.0.1:46748 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:43382 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:53582 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:44240 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:44252 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-253479737_1 at /127.0.0.1:59064 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 240) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7893 (was 7950) 2023-10-03 10:01:27,281 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-03 10:01:27,299 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=168, AvailableMemoryMB=7892 2023-10-03 10:01:27,300 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-03 10:01:27,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-03 10:01:27,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-03 10:01:27,304 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-03 10:01:27,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-03 10:01:27,305 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-03 10:01:27,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-03 10:01:27,307 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:27,307 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:27,307 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28 empty. 2023-10-03 10:01:27,307 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3 empty. 2023-10-03 10:01:27,308 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:27,308 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:27,308 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-03 10:01:27,319 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-03 10:01:27,320 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0f46861dc5d8feedf770b4051527dd28, NAME => 'testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:01:27,320 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0bfb140820dea978fad20151e730b2a3, NAME => 'testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0f46861dc5d8feedf770b4051527dd28, disabling compactions & flushes 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0bfb140820dea978fad20151e730b2a3, disabling compactions & flushes 2023-10-03 10:01:27,335 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:27,335 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. after waiting 0 ms 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:27,335 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0f46861dc5d8feedf770b4051527dd28: 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. after waiting 0 ms 2023-10-03 10:01:27,335 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:27,336 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:27,336 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0bfb140820dea978fad20151e730b2a3: 2023-10-03 10:01:27,337 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-03 10:01:27,338 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696327287338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327287338"}]},"ts":"1696327287338"} 2023-10-03 10:01:27,338 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696327287338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327287338"}]},"ts":"1696327287338"} 2023-10-03 10:01:27,340 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-03 10:01:27,341 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-03 10:01:27,341 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327287341"}]},"ts":"1696327287341"} 2023-10-03 10:01:27,342 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-03 10:01:27,345 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-03 10:01:27,346 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-03 10:01:27,346 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-03 10:01:27,346 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-03 10:01:27,346 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-03 10:01:27,346 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f46861dc5d8feedf770b4051527dd28, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0bfb140820dea978fad20151e730b2a3, ASSIGN}] 2023-10-03 10:01:27,348 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f46861dc5d8feedf770b4051527dd28, ASSIGN 2023-10-03 10:01:27,348 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0bfb140820dea978fad20151e730b2a3, ASSIGN 2023-10-03 10:01:27,349 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f46861dc5d8feedf770b4051527dd28, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36133,1696327199942; forceNewPlan=false, retain=false 2023-10-03 10:01:27,349 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0bfb140820dea978fad20151e730b2a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42977,1696327199993; forceNewPlan=false, retain=false 2023-10-03 10:01:27,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-03 10:01:27,499 INFO [jenkins-hbase4:33857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-03 10:01:27,502 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0f46861dc5d8feedf770b4051527dd28, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:27,502 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=0bfb140820dea978fad20151e730b2a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:27,502 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696327287502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327287502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327287502"}]},"ts":"1696327287502"} 2023-10-03 10:01:27,502 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696327287502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327287502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327287502"}]},"ts":"1696327287502"} 2023-10-03 10:01:27,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 0f46861dc5d8feedf770b4051527dd28, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:01:27,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 0bfb140820dea978fad20151e730b2a3, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:01:27,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-03 10:01:27,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:27,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f46861dc5d8feedf770b4051527dd28, NAME => 'testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.', STARTKEY => '', ENDKEY => '1'} 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bfb140820dea978fad20151e730b2a3, NAME => 'testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.', STARTKEY => '1', ENDKEY => ''} 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. service=AccessControlService 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. service=AccessControlService 2023-10-03 10:01:27,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:01:27,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:27,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:27,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:27,661 INFO [StoreOpener-0f46861dc5d8feedf770b4051527dd28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:27,661 INFO [StoreOpener-0bfb140820dea978fad20151e730b2a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:27,662 DEBUG [StoreOpener-0f46861dc5d8feedf770b4051527dd28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/cf 2023-10-03 10:01:27,662 DEBUG [StoreOpener-0bfb140820dea978fad20151e730b2a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/cf 2023-10-03 10:01:27,662 DEBUG [StoreOpener-0f46861dc5d8feedf770b4051527dd28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/cf 2023-10-03 10:01:27,662 DEBUG [StoreOpener-0bfb140820dea978fad20151e730b2a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/cf 2023-10-03 10:01:27,662 INFO [StoreOpener-0bfb140820dea978fad20151e730b2a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bfb140820dea978fad20151e730b2a3 columnFamilyName cf 2023-10-03 10:01:27,662 INFO [StoreOpener-0f46861dc5d8feedf770b4051527dd28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f46861dc5d8feedf770b4051527dd28 columnFamilyName cf 2023-10-03 10:01:27,664 INFO [StoreOpener-0bfb140820dea978fad20151e730b2a3-1] regionserver.HStore(310): Store=0bfb140820dea978fad20151e730b2a3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:01:27,664 INFO [StoreOpener-0f46861dc5d8feedf770b4051527dd28-1] regionserver.HStore(310): Store=0f46861dc5d8feedf770b4051527dd28/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:01:27,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:27,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:27,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:27,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:27,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:27,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:27,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:01:27,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:01:27,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0bfb140820dea978fad20151e730b2a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70884700, jitterRate=0.05626434087753296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:01:27,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0bfb140820dea978fad20151e730b2a3: 2023-10-03 10:01:27,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f46861dc5d8feedf770b4051527dd28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63216855, jitterRate=-0.05799545347690582}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:01:27,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f46861dc5d8feedf770b4051527dd28: 2023-10-03 10:01:27,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3., pid=94, masterSystemTime=1696327287656 2023-10-03 10:01:27,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28., pid=93, masterSystemTime=1696327287656 2023-10-03 10:01:27,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:27,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:27,677 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=0bfb140820dea978fad20151e730b2a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:27,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:27,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:27,677 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696327287677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327287677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327287677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327287677"}]},"ts":"1696327287677"} 2023-10-03 10:01:27,677 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0f46861dc5d8feedf770b4051527dd28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:27,677 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696327287677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327287677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327287677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327287677"}]},"ts":"1696327287677"} 2023-10-03 10:01:27,680 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-10-03 10:01:27,680 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 0bfb140820dea978fad20151e730b2a3, server=jenkins-hbase4.apache.org,42977,1696327199993 in 174 msec 2023-10-03 10:01:27,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-03 10:01:27,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 0f46861dc5d8feedf770b4051527dd28, server=jenkins-hbase4.apache.org,36133,1696327199942 in 175 msec 2023-10-03 10:01:27,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0bfb140820dea978fad20151e730b2a3, ASSIGN in 334 msec 2023-10-03 10:01:27,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-03 10:01:27,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f46861dc5d8feedf770b4051527dd28, ASSIGN in 335 msec 2023-10-03 10:01:27,683 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-03 10:01:27,683 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327287683"}]},"ts":"1696327287683"} 2023-10-03 10:01:27,684 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-03 10:01:27,686 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-03 10:01:27,686 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-03 10:01:27,687 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-03 10:01:27,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:27,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:27,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:27,690 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:27,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:27,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:27,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:27,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:27,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 390 msec 2023-10-03 10:01:27,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-03 10:01:27,908 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-03 10:01:27,911 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-03 10:01:27,911 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:27,913 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:01:27,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:01:27,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327287924 (current time:1696327287924). 2023-10-03 10:01:27,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:01:27,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x09c8aa04 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:27,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fbf4a67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:27,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:27,935 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:27,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09c8aa04 to 127.0.0.1:56716 2023-10-03 10:01:27,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:27,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x7ecf205e to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:27,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@321b3d09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:27,947 DEBUG [hconnection-0x17d2a55f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:27,949 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:27,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:27,953 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:27,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ecf205e to 127.0.0.1:56716 2023-10-03 10:01:27,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:27,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-03 10:01:27,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:01:27,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:01:27,957 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:01:27,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:01:27,962 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:01:27,963 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696327887962 2023-10-03 10:01:27,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-03 10:01:27,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:01:27,964 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:01:27,964 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:01:27,965 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:01:27,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-03 10:01:27,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-03 10:01:27,969 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-03 10:01:27,969 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696327887969 2023-10-03 10:01:27,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,985 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-03 10:01:27,985 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:27,987 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-03 10:01:27,987 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-03 10:01:27,987 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,987 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,993 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:27,993 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:27,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:27,993 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:27,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:27,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:27,993 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,994 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:27,994 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:27,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,994 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:27,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-03 10:01:27,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-03 10:01:27,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-03 10:01:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,994 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:01:27,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-03 10:01:27,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-03 10:01:27,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,995 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-03 10:01:27,995 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-03 10:01:27,995 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:27,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-03 10:01:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-03 10:01:27,996 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-03 10:01:27,995 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:27,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:27,997 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-03 10:01:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-03 10:01:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-03 10:01:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-03 10:01:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-03 10:01:27,999 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-03 10:01:27,999 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-03 10:01:27,999 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-03 10:01:28,000 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,000 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:28,001 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,001 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,003 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,003 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:28,003 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,003 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:28,003 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:28,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:28,004 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,004 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:28,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:28,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-03 10:01:28,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@697fc346[Count = 1] remaining members to acquire global barrier 2023-10-03 10:01:28,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:28,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:28,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-03 10:01:28,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@697fc346[Count = 0] remaining members to acquire global barrier 2023-10-03 10:01:28,008 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-03 10:01:28,008 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,009 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,009 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,009 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,009 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:01:28,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,009 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:01:28,009 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-03 10:01:28,009 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:28,009 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,010 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:28,010 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:28,010 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. started... 2023-10-03 10:01:28,010 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:01:28,009 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:01:28,010 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,010 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:01:28,011 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0bfb140820dea978fad20151e730b2a3: 2023-10-03 10:01:28,011 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:28,011 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:28,011 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:28,011 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,011 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. started... 2023-10-03 10:01:28,011 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:28,011 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:01:28,011 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f46861dc5d8feedf770b4051527dd28: 2023-10-03 10:01:28,012 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,012 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:28,012 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:01:28,012 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-03 10:01:28,012 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:28,012 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-03 10:01:28,021 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. completed. 2023-10-03 10:01:28,021 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-03 10:01:28,021 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. completed. 2023-10-03 10:01:28,021 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:01:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-03 10:01:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:01:28,022 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-03 10:01:28,022 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:28,022 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,022 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-03 10:01:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:28,024 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,024 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-03 10:01:28,024 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:28,024 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-03 10:01:28,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36133,1696327199942': 2023-10-03 10:01:28,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-03 10:01:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42977,1696327199993': 2023-10-03 10:01:28,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-03 10:01:28,030 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-03 10:01:28,030 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:01:28,030 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:01:28,030 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,030 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:01:28,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,032 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:28,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:28,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,033 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:28,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,033 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:28,034 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:28,035 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,036 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,036 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,040 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,040 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:28,040 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:28,040 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:28,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,040 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:28,040 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:28,040 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:28,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:28,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-03 10:01:28,040 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:28,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,040 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:01:28,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:28,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:28,040 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,041 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,042 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,042 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,042 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,042 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,042 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,042 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-03 10:01:28,042 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,064 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:28,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-03 10:01:28,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:01:28,065 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:01:28,066 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-03 10:01:28,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,066 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696327287963Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696327288050 (+87 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696327288050Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696327288050Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696327288053 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696327288060 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696327288066 (+6 ms) 2023-10-03 10:01:28,069 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-03 10:01:28,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 106 msec 2023-10-03 10:01:28,265 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:28,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-03 10:01:28,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:01:28,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36133] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:01:28,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42977] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:01:28,272 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-03 10:01:28,272 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:28,273 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:01:28,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:01:28,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327288282 (current time:1696327288282). 2023-10-03 10:01:28,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:01:28,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x5c64fb8d to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:28,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c7a94ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:28,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:28,292 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:28,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c64fb8d to 127.0.0.1:56716 2023-10-03 10:01:28,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:28,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x0b76fe47 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:28,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70b5c437, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:28,299 DEBUG [hconnection-0x7862f179-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:28,300 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:28,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:28,306 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:28,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b76fe47 to 127.0.0.1:56716 2023-10-03 10:01:28,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:28,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-03 10:01:28,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:01:28,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:01:28,310 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:01:28,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:01:28,312 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:01:28,313 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696327888313 2023-10-03 10:01:28,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-03 10:01:28,313 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-03 10:01:28,314 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:01:28,315 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-03 10:01:28,315 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:01:28,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-03 10:01:28,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-03 10:01:28,316 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-03 10:01:28,317 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696327888317 2023-10-03 10:01:28,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,324 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-03 10:01:28,324 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:28,325 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-03 10:01:28,325 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-03 10:01:28,326 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,326 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,327 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,327 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:28,327 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:28,327 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:28,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:28,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:28,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:28,327 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:28,328 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,328 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,328 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:01:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-03 10:01:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-03 10:01:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-03 10:01:28,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-03 10:01:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-03 10:01:28,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-03 10:01:28,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,329 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-03 10:01:28,329 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:28,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,329 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-03 10:01:28,329 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-03 10:01:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-03 10:01:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-03 10:01:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-03 10:01:28,331 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-03 10:01:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-03 10:01:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-03 10:01:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:28,334 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-03 10:01:28,334 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-03 10:01:28,334 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-03 10:01:28,336 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,336 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:28,336 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,337 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,337 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:28,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:28,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-03 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@672de2dc[Count = 1] remaining members to acquire global barrier 2023-10-03 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:28,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-03 10:01:28,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@672de2dc[Count = 0] remaining members to acquire global barrier 2023-10-03 10:01:28,340 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-03 10:01:28,340 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,344 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,345 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,344 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,345 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:01:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:01:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-03 10:01:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-03 10:01:28,345 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,345 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:01:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:28,345 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:01:28,345 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. started... 2023-10-03 10:01:28,345 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:28,345 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:28,345 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. started... 2023-10-03 10:01:28,345 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0f46861dc5d8feedf770b4051527dd28 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-03 10:01:28,346 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0bfb140820dea978fad20151e730b2a3 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-03 10:01:28,347 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-03 10:01:28,347 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:28,347 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-03 10:01:28,362 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231003abb0f73f77934c21b3eec58eef40ccb2 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231003abb0f73f77934c21b3eec58eef40ccb2 2023-10-03 10:01:28,363 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231003464287369ed543a6af88e5f22388d93c to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231003464287369ed543a6af88e5f22388d93c 2023-10-03 10:01:28,372 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/.tmp/cf/edb43ebe7cec4b83989aa5e813d92dbb 2023-10-03 10:01:28,374 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/.tmp/cf/6b22cf9dd0b04c368701e6599f306cb1 2023-10-03 10:01:28,377 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/.tmp/cf/edb43ebe7cec4b83989aa5e813d92dbb as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/cf/edb43ebe7cec4b83989aa5e813d92dbb 2023-10-03 10:01:28,379 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/.tmp/cf/6b22cf9dd0b04c368701e6599f306cb1 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/cf/6b22cf9dd0b04c368701e6599f306cb1 2023-10-03 10:01:28,382 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/cf/edb43ebe7cec4b83989aa5e813d92dbb, entries=4, sequenceid=6, filesize=5.6 K 2023-10-03 10:01:28,383 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 0f46861dc5d8feedf770b4051527dd28 in 38ms, sequenceid=6, compaction requested=false 2023-10-03 10:01:28,383 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-03 10:01:28,383 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f46861dc5d8feedf770b4051527dd28: 2023-10-03 10:01:28,384 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,384 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:28,384 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/cf/edb43ebe7cec4b83989aa5e813d92dbb] hfiles 2023-10-03 10:01:28,384 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/cf/edb43ebe7cec4b83989aa5e813d92dbb for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,385 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/cf/6b22cf9dd0b04c368701e6599f306cb1, entries=46, sequenceid=6, filesize=12.9 K 2023-10-03 10:01:28,386 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 0bfb140820dea978fad20151e730b2a3 in 40ms, sequenceid=6, compaction requested=false 2023-10-03 10:01:28,388 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0bfb140820dea978fad20151e730b2a3: 2023-10-03 10:01:28,388 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,389 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:28,389 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/cf/6b22cf9dd0b04c368701e6599f306cb1] hfiles 2023-10-03 10:01:28,389 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/cf/6b22cf9dd0b04c368701e6599f306cb1 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,398 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. completed. 2023-10-03 10:01:28,398 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:28,398 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:28,398 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:28,398 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,398 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-03 10:01:28,398 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:01:28,400 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-03 10:01:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-03 10:01:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36133,1696327199942': 2023-10-03 10:01:28,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-03 10:01:28,409 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. completed. 2023-10-03 10:01:28,409 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-03 10:01:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:01:28,411 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,411 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-03 10:01:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:28,411 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:28,411 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-03 10:01:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,415 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42977,1696327199993': 2023-10-03 10:01:28,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-03 10:01:28,415 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-03 10:01:28,415 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:01:28,415 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:01:28,415 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,415 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:01:28,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-03 10:01:28,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:01:28,416 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:01:28,418 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,418 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,419 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,419 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,421 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,421 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:28,421 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,424 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,424 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:28,424 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,424 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,424 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:28,424 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:28,424 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:28,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:28,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:28,424 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,424 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:28,424 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,424 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:28,425 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,425 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-03 10:01:28,425 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:28,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:28,425 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:28,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,426 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:28,426 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:28,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:01:28,426 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:28,426 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,426 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231003464287369ed543a6af88e5f22388d93c, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231003abb0f73f77934c21b3eec58eef40ccb2] mob files 2023-10-03 10:01:28,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231003464287369ed543a6af88e5f22388d93c 2023-10-03 10:01:28,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231003abb0f73f77934c21b3eec58eef40ccb2 2023-10-03 10:01:28,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,449 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-03 10:01:28,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,449 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696327288313Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696327288433 (+120 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696327288433Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696327288433Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696327288436 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696327288442 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696327288449 (+7 ms) 2023-10-03 10:01:28,454 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-03 10:01:28,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 141 msec 2023-10-03 10:01:28,616 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:28,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-03 10:01:28,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:01:28,617 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327288617 2023-10-03 10:01:28,618 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36071, tgtDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327288617, rawTgtDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327288617, srcFsUri=hdfs://localhost:36071, srcDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:01:28,639 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:01:28,639 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1797952751_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327288617, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327288617/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,639 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead, snapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-03 10:01:28,644 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327288617/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:28,665 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,666 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,666 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,666 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,667 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,667 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,667 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,734 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop-6695679153283178193.jar 2023-10-03 10:01:28,734 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,735 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,735 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,735 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,736 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,736 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:28,736 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-03 10:01:28,736 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-03 10:01:28,737 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-03 10:01:28,737 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-03 10:01:28,737 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-03 10:01:28,738 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-03 10:01:28,738 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-03 10:01:28,739 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-03 10:01:28,739 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-03 10:01:28,739 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-03 10:01:28,740 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:28,740 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:28,740 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:01:28,740 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:28,741 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:28,741 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:01:28,741 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:01:29,108 WARN [Listener at jenkins-hbase4.apache.org/39739] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-03 10:01:29,110 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-03 10:01:30,848 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:01:30,849 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:01:30,855 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0005_000001 (auth:SIMPLE) 2023-10-03 10:01:31,529 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0006_000001 (auth:SIMPLE) 2023-10-03 10:01:32,171 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-03 10:01:35,267 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0006_000001 (auth:SIMPLE) 2023-10-03 10:01:37,474 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-03 10:01:37,474 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-03 10:01:37,478 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:37,479 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-03 10:01:37,479 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-03 10:01:37,479 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:37,480 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-03 10:01:37,480 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-03 10:01:37,480 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327288617/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327288617/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:37,480 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327288617/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-03 10:01:37,480 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327288617/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-03 10:01:37,484 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-03 10:01:37,489 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327297489"}]},"ts":"1696327297489"} 2023-10-03 10:01:37,490 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-03 10:01:37,492 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-03 10:01:37,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f46861dc5d8feedf770b4051527dd28, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0bfb140820dea978fad20151e730b2a3, UNASSIGN}] 2023-10-03 10:01:37,494 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f46861dc5d8feedf770b4051527dd28, UNASSIGN 2023-10-03 10:01:37,494 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0bfb140820dea978fad20151e730b2a3, UNASSIGN 2023-10-03 10:01:37,495 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0f46861dc5d8feedf770b4051527dd28, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:37,495 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696327297494"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327297494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327297494"}]},"ts":"1696327297494"} 2023-10-03 10:01:37,495 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=0bfb140820dea978fad20151e730b2a3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:37,495 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696327297495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327297495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327297495"}]},"ts":"1696327297495"} 2023-10-03 10:01:37,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 0f46861dc5d8feedf770b4051527dd28, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:01:37,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 0bfb140820dea978fad20151e730b2a3, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:01:37,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-03 10:01:37,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:37,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f46861dc5d8feedf770b4051527dd28, disabling compactions & flushes 2023-10-03 10:01:37,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:37,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:37,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. after waiting 0 ms 2023-10-03 10:01:37,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:37,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:37,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0bfb140820dea978fad20151e730b2a3, disabling compactions & flushes 2023-10-03 10:01:37,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:37,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:37,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. after waiting 0 ms 2023-10-03 10:01:37,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:37,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:01:37,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:01:37,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:37,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28. 2023-10-03 10:01:37,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f46861dc5d8feedf770b4051527dd28: 2023-10-03 10:01:37,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:37,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3. 2023-10-03 10:01:37,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0bfb140820dea978fad20151e730b2a3: 2023-10-03 10:01:37,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:37,661 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0f46861dc5d8feedf770b4051527dd28, regionState=CLOSED 2023-10-03 10:01:37,661 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696327297661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327297661"}]},"ts":"1696327297661"} 2023-10-03 10:01:37,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:37,662 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=0bfb140820dea978fad20151e730b2a3, regionState=CLOSED 2023-10-03 10:01:37,662 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696327297662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327297662"}]},"ts":"1696327297662"} 2023-10-03 10:01:37,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-03 10:01:37,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 0f46861dc5d8feedf770b4051527dd28, server=jenkins-hbase4.apache.org,36133,1696327199942 in 167 msec 2023-10-03 10:01:37,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-03 10:01:37,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 0bfb140820dea978fad20151e730b2a3, server=jenkins-hbase4.apache.org,42977,1696327199993 in 168 msec 2023-10-03 10:01:37,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0f46861dc5d8feedf770b4051527dd28, UNASSIGN in 173 msec 2023-10-03 10:01:37,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-03 10:01:37,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0bfb140820dea978fad20151e730b2a3, UNASSIGN in 173 msec 2023-10-03 10:01:37,668 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327297668"}]},"ts":"1696327297668"} 2023-10-03 10:01:37,669 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-03 10:01:37,670 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-03 10:01:37,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 186 msec 2023-10-03 10:01:37,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-03 10:01:37,791 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-03 10:01:37,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,794 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,795 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,796 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,798 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:37,798 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:37,800 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,800 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,800 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,800 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,800 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/recovered.edits] 2023-10-03 10:01:37,800 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/recovered.edits] 2023-10-03 10:01:37,800 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-03 10:01:37,800 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-03 10:01:37,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-03 10:01:37,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-03 10:01:37,801 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,801 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,801 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:37,801 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,801 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:37,801 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,801 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:37,801 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:37,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-03 10:01:37,804 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/cf/edb43ebe7cec4b83989aa5e813d92dbb to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/cf/edb43ebe7cec4b83989aa5e813d92dbb 2023-10-03 10:01:37,804 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/cf/6b22cf9dd0b04c368701e6599f306cb1 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/cf/6b22cf9dd0b04c368701e6599f306cb1 2023-10-03 10:01:37,807 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28/recovered.edits/9.seqid 2023-10-03 10:01:37,807 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3/recovered.edits/9.seqid 2023-10-03 10:01:37,807 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0f46861dc5d8feedf770b4051527dd28 2023-10-03 10:01:37,807 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testEmptyExportFileSystemState/0bfb140820dea978fad20151e730b2a3 2023-10-03 10:01:37,807 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-03 10:01:37,808 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-03 10:01:37,808 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-03 10:01:37,811 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231003464287369ed543a6af88e5f22388d93c to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231003464287369ed543a6af88e5f22388d93c 2023-10-03 10:01:37,812 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231003abb0f73f77934c21b3eec58eef40ccb2 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231003abb0f73f77934c21b3eec58eef40ccb2 2023-10-03 10:01:37,812 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-03 10:01:37,814 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,816 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-03 10:01:37,818 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-03 10:01:37,818 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,818 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-03 10:01:37,819 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327297819"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:37,819 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327297819"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:37,820 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-03 10:01:37,820 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0f46861dc5d8feedf770b4051527dd28, NAME => 'testtb-testEmptyExportFileSystemState,,1696327287301.0f46861dc5d8feedf770b4051527dd28.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0bfb140820dea978fad20151e730b2a3, NAME => 'testtb-testEmptyExportFileSystemState,1,1696327287301.0bfb140820dea978fad20151e730b2a3.', STARTKEY => '1', ENDKEY => ''}] 2023-10-03 10:01:37,820 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-03 10:01:37,821 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696327297820"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:37,822 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-03 10:01:37,823 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-03 10:01:37,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 32 msec 2023-10-03 10:01:37,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-03 10:01:37,903 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-03 10:01:37,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-03 10:01:37,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:37,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-03 10:01:37,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-03 10:01:37,937 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:38024 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:44521 from appattempt_1696327206317_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_938765782_1 at /127.0.0.1:43744 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_938765782_1 at /127.0.0.1:38004 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4726 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:60876 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:38607 from appattempt_1696327206317_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:55368 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:43799 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=942 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 244), ProcessCount=168 (was 168), AvailableMemoryMB=7875 (was 7892) 2023-10-03 10:01:37,937 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-03 10:01:37,956 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=942, MaxFileDescriptor=60000, SystemLoadAverage=239, ProcessCount=168, AvailableMemoryMB=7874 2023-10-03 10:01:37,956 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-03 10:01:37,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-03 10:01:37,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:37,960 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-03 10:01:37,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-03 10:01:37,960 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-03 10:01:37,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-03 10:01:37,962 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:37,962 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182 2023-10-03 10:01:37,963 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431 empty. 2023-10-03 10:01:37,963 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182 empty. 2023-10-03 10:01:37,963 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:37,963 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182 2023-10-03 10:01:37,963 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-03 10:01:37,972 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-03 10:01:37,973 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => d0529af19a6c4d5ce8e9543c089f3431, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:01:37,973 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8be7bca1825beadf4a27319398411182, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp 2023-10-03 10:01:37,986 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:37,986 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing d0529af19a6c4d5ce8e9543c089f3431, disabling compactions & flushes 2023-10-03 10:01:37,986 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:37,986 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:37,986 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. after waiting 0 ms 2023-10-03 10:01:37,986 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:37,986 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:37,986 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for d0529af19a6c4d5ce8e9543c089f3431: 2023-10-03 10:01:37,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:37,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 8be7bca1825beadf4a27319398411182, disabling compactions & flushes 2023-10-03 10:01:37,988 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:37,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:37,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. after waiting 0 ms 2023-10-03 10:01:37,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:37,988 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:37,988 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 8be7bca1825beadf4a27319398411182: 2023-10-03 10:01:37,990 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-03 10:01:37,991 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696327297991"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327297991"}]},"ts":"1696327297991"} 2023-10-03 10:01:37,991 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696327297991"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327297991"}]},"ts":"1696327297991"} 2023-10-03 10:01:37,993 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-03 10:01:37,994 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-03 10:01:37,994 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327297994"}]},"ts":"1696327297994"} 2023-10-03 10:01:37,995 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-03 10:01:37,998 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-03 10:01:37,999 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-03 10:01:37,999 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-03 10:01:37,999 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-03 10:01:37,999 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-03 10:01:37,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d0529af19a6c4d5ce8e9543c089f3431, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8be7bca1825beadf4a27319398411182, ASSIGN}] 2023-10-03 10:01:38,001 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8be7bca1825beadf4a27319398411182, ASSIGN 2023-10-03 10:01:38,002 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d0529af19a6c4d5ce8e9543c089f3431, ASSIGN 2023-10-03 10:01:38,002 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8be7bca1825beadf4a27319398411182, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42977,1696327199993; forceNewPlan=false, retain=false 2023-10-03 10:01:38,002 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d0529af19a6c4d5ce8e9543c089f3431, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36133,1696327199942; forceNewPlan=false, retain=false 2023-10-03 10:01:38,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-03 10:01:38,152 INFO [jenkins-hbase4:33857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-03 10:01:38,155 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d0529af19a6c4d5ce8e9543c089f3431, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,155 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8be7bca1825beadf4a27319398411182, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,155 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696327298155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327298155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327298155"}]},"ts":"1696327298155"} 2023-10-03 10:01:38,155 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696327298155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327298155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327298155"}]},"ts":"1696327298155"} 2023-10-03 10:01:38,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure d0529af19a6c4d5ce8e9543c089f3431, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:01:38,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 8be7bca1825beadf4a27319398411182, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:01:38,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-03 10:01:38,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:38,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d0529af19a6c4d5ce8e9543c089f3431, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.', STARTKEY => '', ENDKEY => '1'} 2023-10-03 10:01:38,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8be7bca1825beadf4a27319398411182, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.', STARTKEY => '1', ENDKEY => ''} 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. service=AccessControlService 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. service=AccessControlService 2023-10-03 10:01:38,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:01:38,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 8be7bca1825beadf4a27319398411182 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8be7bca1825beadf4a27319398411182 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8be7bca1825beadf4a27319398411182 2023-10-03 10:01:38,313 INFO [StoreOpener-d0529af19a6c4d5ce8e9543c089f3431-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:38,313 INFO [StoreOpener-8be7bca1825beadf4a27319398411182-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8be7bca1825beadf4a27319398411182 2023-10-03 10:01:38,315 DEBUG [StoreOpener-d0529af19a6c4d5ce8e9543c089f3431-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/cf 2023-10-03 10:01:38,315 DEBUG [StoreOpener-8be7bca1825beadf4a27319398411182-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/cf 2023-10-03 10:01:38,315 DEBUG [StoreOpener-8be7bca1825beadf4a27319398411182-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/cf 2023-10-03 10:01:38,315 DEBUG [StoreOpener-d0529af19a6c4d5ce8e9543c089f3431-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/cf 2023-10-03 10:01:38,315 INFO [StoreOpener-8be7bca1825beadf4a27319398411182-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8be7bca1825beadf4a27319398411182 columnFamilyName cf 2023-10-03 10:01:38,315 INFO [StoreOpener-d0529af19a6c4d5ce8e9543c089f3431-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0529af19a6c4d5ce8e9543c089f3431 columnFamilyName cf 2023-10-03 10:01:38,316 INFO [StoreOpener-d0529af19a6c4d5ce8e9543c089f3431-1] regionserver.HStore(310): Store=d0529af19a6c4d5ce8e9543c089f3431/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:01:38,316 INFO [StoreOpener-8be7bca1825beadf4a27319398411182-1] regionserver.HStore(310): Store=8be7bca1825beadf4a27319398411182/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-03 10:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182 2023-10-03 10:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:38,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182 2023-10-03 10:01:38,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:38,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8be7bca1825beadf4a27319398411182 2023-10-03 10:01:38,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:38,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:01:38,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-03 10:01:38,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d0529af19a6c4d5ce8e9543c089f3431; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62128235, jitterRate=-0.07421715557575226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:01:38,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d0529af19a6c4d5ce8e9543c089f3431: 2023-10-03 10:01:38,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8be7bca1825beadf4a27319398411182; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62439476, jitterRate=-0.06957930326461792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-03 10:01:38,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8be7bca1825beadf4a27319398411182: 2023-10-03 10:01:38,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431., pid=108, masterSystemTime=1696327298309 2023-10-03 10:01:38,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182., pid=109, masterSystemTime=1696327298309 2023-10-03 10:01:38,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:38,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:38,325 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8be7bca1825beadf4a27319398411182, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:38,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:38,325 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696327298325"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327298325"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327298325"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327298325"}]},"ts":"1696327298325"} 2023-10-03 10:01:38,325 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d0529af19a6c4d5ce8e9543c089f3431, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,325 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696327298325"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696327298325"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696327298325"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696327298325"}]},"ts":"1696327298325"} 2023-10-03 10:01:38,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-03 10:01:38,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 8be7bca1825beadf4a27319398411182, server=jenkins-hbase4.apache.org,42977,1696327199993 in 169 msec 2023-10-03 10:01:38,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8be7bca1825beadf4a27319398411182, ASSIGN in 329 msec 2023-10-03 10:01:38,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-03 10:01:38,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure d0529af19a6c4d5ce8e9543c089f3431, server=jenkins-hbase4.apache.org,36133,1696327199942 in 171 msec 2023-10-03 10:01:38,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-03 10:01:38,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d0529af19a6c4d5ce8e9543c089f3431, ASSIGN in 330 msec 2023-10-03 10:01:38,331 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-03 10:01:38,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327298331"}]},"ts":"1696327298331"} 2023-10-03 10:01:38,332 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-03 10:01:38,334 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-03 10:01:38,334 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-03 10:01:38,335 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-03 10:01:38,337 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:38,337 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:38,337 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:38,337 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:38,338 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:38,338 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:38,338 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:38,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-03 10:01:38,339 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 381 msec 2023-10-03 10:01:38,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-03 10:01:38,563 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-03 10:01:38,565 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,565 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:38,567 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:01:38,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-03 10:01:38,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327298577 (current time:1696327298577). 2023-10-03 10:01:38,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:01:38,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x167b00e8 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:38,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56375e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:38,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:38,587 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:38,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x167b00e8 to 127.0.0.1:56716 2023-10-03 10:01:38,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:38,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x37ce4c03 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:38,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79fc6652, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:38,595 DEBUG [hconnection-0x672ec0f8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:38,597 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:38,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:38,602 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:38,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37ce4c03 to 127.0.0.1:56716 2023-10-03 10:01:38,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:38,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-03 10:01:38,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:01:38,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-03 10:01:38,606 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:01:38,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-03 10:01:38,609 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-03 10:01:38,609 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696327898609 2023-10-03 10:01:38,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-03 10:01:38,611 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:01:38,611 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:01:38,611 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-03 10:01:38,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-03 10:01:38,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-03 10:01:38,613 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-03 10:01:38,614 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696327898614 2023-10-03 10:01:38,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,628 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-03 10:01:38,629 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:38,630 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-03 10:01:38,630 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-03 10:01:38,630 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,630 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,634 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:38,634 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:38,634 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:38,634 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:38,634 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:38,634 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,634 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,634 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-03 10:01:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-03 10:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:38,636 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-03 10:01:38,637 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:38,636 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:38,638 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-03 10:01:38,638 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-03 10:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-03 10:01:38,637 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-03 10:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-03 10:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-03 10:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-03 10:01:38,638 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-03 10:01:38,639 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-03 10:01:38,645 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,645 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,645 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:38,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:38,646 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:38,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:38,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-03 10:01:38,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@441ad5a8[Count = 1] remaining members to acquire global barrier 2023-10-03 10:01:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:38,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-03 10:01:38,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@441ad5a8[Count = 0] remaining members to acquire global barrier 2023-10-03 10:01:38,650 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-03 10:01:38,650 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,652 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,652 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,652 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-03 10:01:38,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-03 10:01:38,652 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-03 10:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,653 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-03 10:01:38,653 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:38,653 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:38,653 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:38,653 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,653 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:01:38,653 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. started... 2023-10-03 10:01:38,654 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-03 10:01:38,654 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:38,654 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-03 10:01:38,658 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:38,658 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8be7bca1825beadf4a27319398411182: 2023-10-03 10:01:38,658 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:38,658 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:38,658 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,658 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. started... 2023-10-03 10:01:38,658 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:38,658 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:01:38,658 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d0529af19a6c4d5ce8e9543c089f3431: 2023-10-03 10:01:38,658 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,658 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:38,658 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-03 10:01:38,673 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. completed. 2023-10-03 10:01:38,673 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:38,673 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:38,673 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:38,673 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-03 10:01:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:01:38,674 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. completed. 2023-10-03 10:01:38,674 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-03 10:01:38,674 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:01:38,675 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-03 10:01:38,675 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,675 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:38,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:38,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:38,675 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-03 10:01:38,677 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,677 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-03 10:01:38,677 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:38,677 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-03 10:01:38,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:38,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:38,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:38,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36133,1696327199942': 2023-10-03 10:01:38,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-03 10:01:38,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:38,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:38,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:38,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:38,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:38,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42977,1696327199993': 2023-10-03 10:01:38,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-03 10:01:38,684 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-03 10:01:38,685 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:01:38,685 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:01:38,685 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,685 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:01:38,687 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,688 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,688 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:38,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:38,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:38,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,687 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,687 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,688 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:38,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,688 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:38,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:38,688 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:38,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:38,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:38,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:38,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:38,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:38,689 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:38,689 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:38,690 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,691 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,691 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,694 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,695 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:38,695 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:38,695 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:38,695 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:38,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:38,695 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,695 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:38,695 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:38,696 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,695 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:38,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,695 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:38,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:01:38,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:38,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:38,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:38,695 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:38,696 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,696 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,696 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,697 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,697 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,697 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:38,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-03 10:01:38,697 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:38,705 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,712 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:38,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-03 10:01:38,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:01:38,713 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:01:38,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,721 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-03 10:01:38,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,721 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696327298609Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696327298705 (+96 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696327298705Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696327298706 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696327298709 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696327298716 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696327298721 (+5 ms) 2023-10-03 10:01:38,724 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-03 10:01:38,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 114 msec 2023-10-03 10:01:38,913 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:38,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-03 10:01:38,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:01:38,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36133] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:01:38,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42977] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. with WAL disabled. Data may be lost in the event of a crash. 2023-10-03 10:01:38,919 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,919 DEBUG [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:38,919 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-03 10:01:38,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-03 10:01:38,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696327298928 (current time:1696327298928). 2023-10-03 10:01:38,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-03 10:01:38,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x024f9410 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:38,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cd56a2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:38,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:38,937 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:38,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x024f9410 to 127.0.0.1:56716 2023-10-03 10:01:38,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:38,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(139): Connect 0x0c25e5a7 to 127.0.0.1:56716 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-03 10:01:38,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72341f27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-03 10:01:38,946 DEBUG [hconnection-0x547b778-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:38,953 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:38,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-03 10:01:38,957 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-03 10:01:38,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c25e5a7 to 127.0.0.1:56716 2023-10-03 10:01:38,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:01:38,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-03 10:01:38,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-03 10:01:38,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-03 10:01:38,961 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot, current working dir path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-03 10:01:38,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-03 10:01:38,963 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-03 10:01:38,963 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696327898963 2023-10-03 10:01:38,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-03 10:01:38,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,965 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-03 10:01:38,965 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-03 10:01:38,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-03 10:01:38,966 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-03 10:01:38,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-03 10:01:38,968 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-03 10:01:38,968 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696327898968 2023-10-03 10:01:38,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,980 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-03 10:01:38,980 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:38,981 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-03 10:01:38,981 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-03 10:01:38,981 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,981 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,982 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:38,983 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:38,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:38,983 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,983 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:38,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:38,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:38,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:38,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:38,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:38,983 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,983 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,983 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,983 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-03 10:01:38,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,984 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-03 10:01:38,984 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-03 10:01:38,984 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:38,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,990 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-03 10:01:38,990 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-03 10:01:38,990 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:38,990 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-03 10:01:38,991 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-03 10:01:38,991 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-03 10:01:38,991 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-03 10:01:38,991 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34139,1696327200029' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-03 10:01:38,990 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-03 10:01:38,991 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-03 10:01:38,992 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-03 10:01:38,992 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-03 10:01:38,992 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-03 10:01:38,994 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,996 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:38,996 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-03 10:01:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42977,1696327199993' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-03 10:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@764861cc[Count = 1] remaining members to acquire global barrier 2023-10-03 10:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:39,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36133,1696327199942' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-03 10:01:39,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@764861cc[Count = 0] remaining members to acquire global barrier 2023-10-03 10:01:39,000 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-03 10:01:39,000 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,004 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,004 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,004 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-03 10:01:39,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-03 10:01:39,004 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-03 10:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34139,1696327200029' in zk 2023-10-03 10:01:39,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-03 10:01:39,005 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-03 10:01:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-03 10:01:39,005 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. started... 2023-10-03 10:01:39,005 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:39,005 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,005 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-03 10:01:39,005 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. started... 2023-10-03 10:01:39,005 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d0529af19a6c4d5ce8e9543c089f3431 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-10-03 10:01:39,005 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8be7bca1825beadf4a27319398411182 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-10-03 10:01:39,006 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-03 10:01:39,006 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:39,006 DEBUG [member: 'jenkins-hbase4.apache.org,34139,1696327200029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-03 10:01:39,021 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100397755e3b1b654f5ea9f4f723edf6914d to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100397755e3b1b654f5ea9f4f723edf6914d 2023-10-03 10:01:39,023 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310036d42ee7d264a4d228f00cbf3c2cdd589 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310036d42ee7d264a4d228f00cbf3c2cdd589 2023-10-03 10:01:39,028 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/.tmp/cf/5c95b305d1b44c42bf00abd537af8a35 2023-10-03 10:01:39,030 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/.tmp/cf/96505467f41548a98158acfd059d4c0a 2023-10-03 10:01:39,033 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/.tmp/cf/5c95b305d1b44c42bf00abd537af8a35 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/cf/5c95b305d1b44c42bf00abd537af8a35 2023-10-03 10:01:39,034 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/.tmp/cf/96505467f41548a98158acfd059d4c0a as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/cf/96505467f41548a98158acfd059d4c0a 2023-10-03 10:01:39,037 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/cf/5c95b305d1b44c42bf00abd537af8a35, entries=6, sequenceid=6, filesize=6.0 K 2023-10-03 10:01:39,038 INFO [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for d0529af19a6c4d5ce8e9543c089f3431 in 33ms, sequenceid=6, compaction requested=false 2023-10-03 10:01:39,038 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-03 10:01:39,038 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/cf/96505467f41548a98158acfd059d4c0a, entries=44, sequenceid=6, filesize=12.8 K 2023-10-03 10:01:39,039 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d0529af19a6c4d5ce8e9543c089f3431: 2023-10-03 10:01:39,039 INFO [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 8be7bca1825beadf4a27319398411182 in 34ms, sequenceid=6, compaction requested=false 2023-10-03 10:01:39,040 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8be7bca1825beadf4a27319398411182: 2023-10-03 10:01:39,040 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,040 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:39,040 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,042 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/cf/5c95b305d1b44c42bf00abd537af8a35] hfiles 2023-10-03 10:01:39,042 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-03 10:01:39,042 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/cf/5c95b305d1b44c42bf00abd537af8a35 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,042 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/cf/96505467f41548a98158acfd059d4c0a] hfiles 2023-10-03 10:01:39,042 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/cf/96505467f41548a98158acfd059d4c0a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,050 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. completed. 2023-10-03 10:01:39,051 DEBUG [rs(jenkins-hbase4.apache.org,36133,1696327199942)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:39,051 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. completed. 2023-10-03 10:01:39,051 DEBUG [rs(jenkins-hbase4.apache.org,42977,1696327199993)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-03 10:01:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-03 10:01:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36133,1696327199942' in zk 2023-10-03 10:01:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-03 10:01:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-03 10:01:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42977,1696327199993' in zk 2023-10-03 10:01:39,053 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,053 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-03 10:01:39,053 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,053 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-03 10:01:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:39,053 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:39,053 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:39,054 DEBUG [member: 'jenkins-hbase4.apache.org,36133,1696327199942' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-03 10:01:39,055 DEBUG [member: 'jenkins-hbase4.apache.org,42977,1696327199993' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-03 10:01:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:39,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36133,1696327199942': 2023-10-03 10:01:39,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36133,1696327199942' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-03 10:01:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42977,1696327199993': 2023-10-03 10:01:39,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42977,1696327199993' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-03 10:01:39,061 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-03 10:01:39,061 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-03 10:01:39,061 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-03 10:01:39,061 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,062 INFO [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-03 10:01:39,063 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-03 10:01:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-03 10:01:39,063 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:39,063 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-03 10:01:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,063 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:39,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:39,064 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:39,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:39,064 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-03 10:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,065 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-03 10:01:39,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-03 10:01:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,066 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:39,066 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-03 10:01:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-03 10:01:39,066 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,067 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,069 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,069 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,069 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:39,069 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:39,069 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,069 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:39,069 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:39,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:39,069 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-03 10:01:39,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:39,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-03 10:01:39,070 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-03 10:01:39,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:39,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-03 10:01:39,069 DEBUG [(jenkins-hbase4.apache.org,33857,1696327198658)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-03 10:01:39,069 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-03 10:01:39,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:39,071 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,072 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:39,072 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,072 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:39,072 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:01:39,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310036d42ee7d264a4d228f00cbf3c2cdd589, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100397755e3b1b654f5ea9f4f723edf6914d] mob files 2023-10-03 10:01:39,072 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-03 10:01:39,072 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310036d42ee7d264a4d228f00cbf3c2cdd589 2023-10-03 10:01:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-03 10:01:39,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100397755e3b1b654f5ea9f4f723edf6914d 2023-10-03 10:01:39,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,094 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-03 10:01:39,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,095 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696327298964Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696327299078 (+114 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696327299078Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696327299079 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696327299082 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696327299088 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696327299094 (+6 ms) 2023-10-03 10:01:39,097 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-03 10:01:39,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 133 msec 2023-10-03 10:01:39,266 DEBUG [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-03 10:01:39,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-03 10:01:39,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-03 10:01:39,267 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327299267 2023-10-03 10:01:39,268 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36071, tgtDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327299267, rawTgtDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327299267, srcFsUri=hdfs://localhost:36071, srcDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:01:39,289 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead 2023-10-03 10:01:39,289 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_329862193_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327299267, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327299267/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,289 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36071, inputRoot=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead, snapshotDir=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-03 10:01:39,301 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327299267/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:39,325 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,326 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,326 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,327 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,327 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,328 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,328 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,399 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/hadoop-3207705795241431555.jar 2023-10-03 10:01:39,399 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,399 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,400 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,400 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,400 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,401 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-03 10:01:39,401 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-03 10:01:39,401 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-03 10:01:39,402 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-03 10:01:39,402 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-03 10:01:39,402 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-03 10:01:39,403 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-03 10:01:39,403 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-03 10:01:39,403 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-03 10:01:39,404 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-03 10:01:39,404 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-03 10:01:39,404 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:39,405 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:39,405 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:01:39,405 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:39,405 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-03 10:01:39,406 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:01:39,406 DEBUG [Listener at jenkins-hbase4.apache.org/39739] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-03 10:01:39,756 WARN [Listener at jenkins-hbase4.apache.org/39739] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-03 10:01:39,758 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-03 10:01:39,760 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-03 10:01:42,587 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:01:42,587 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-03 10:01:42,593 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0006_000001 (auth:SIMPLE) 2023-10-03 10:01:42,858 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0007_000001 (auth:SIMPLE) 2023-10-03 10:01:43,234 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-03 10:01:46,412 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0007_000001 (auth:SIMPLE) 2023-10-03 10:01:48,617 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0007_000001 (auth:SIMPLE) 2023-10-03 10:01:51,613 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0007_000001 (auth:SIMPLE) 2023-10-03 10:01:52,924 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-03 10:01:52,924 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-03 10:01:52,934 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:52,934 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-03 10:01:52,935 INFO [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-03 10:01:52,935 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:52,936 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-03 10:01:52,936 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-03 10:01:52,936 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-839168187_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327299267/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327299267/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:52,936 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327299267/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-03 10:01:52,936 DEBUG [Listener at jenkins-hbase4.apache.org/39739] snapshot.TestExportSnapshot(367): hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/export-test/export-1696327299267/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-03 10:01:52,941 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:52,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:52,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:52,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-03 10:01:52,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327312945"}]},"ts":"1696327312945"} 2023-10-03 10:01:52,946 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-03 10:01:52,947 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-03 10:01:52,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d0529af19a6c4d5ce8e9543c089f3431, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8be7bca1825beadf4a27319398411182, UNASSIGN}] 2023-10-03 10:01:52,949 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d0529af19a6c4d5ce8e9543c089f3431, UNASSIGN 2023-10-03 10:01:52,949 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8be7bca1825beadf4a27319398411182, UNASSIGN 2023-10-03 10:01:52,950 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d0529af19a6c4d5ce8e9543c089f3431, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:01:52,950 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8be7bca1825beadf4a27319398411182, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:01:52,950 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696327312950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327312950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327312950"}]},"ts":"1696327312950"} 2023-10-03 10:01:52,950 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696327312950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696327312950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696327312950"}]},"ts":"1696327312950"} 2023-10-03 10:01:52,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure d0529af19a6c4d5ce8e9543c089f3431, server=jenkins-hbase4.apache.org,36133,1696327199942}] 2023-10-03 10:01:52,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 8be7bca1825beadf4a27319398411182, server=jenkins-hbase4.apache.org,42977,1696327199993}] 2023-10-03 10:01:53,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-03 10:01:53,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8be7bca1825beadf4a27319398411182 2023-10-03 10:01:53,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:53,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8be7bca1825beadf4a27319398411182, disabling compactions & flushes 2023-10-03 10:01:53,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d0529af19a6c4d5ce8e9543c089f3431, disabling compactions & flushes 2023-10-03 10:01:53,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:53,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:53,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:53,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:53,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. after waiting 0 ms 2023-10-03 10:01:53,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:53,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. after waiting 0 ms 2023-10-03 10:01:53,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:53,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:01:53,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:01:53,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:53,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182. 2023-10-03 10:01:53,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8be7bca1825beadf4a27319398411182: 2023-10-03 10:01:53,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:01:53,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431. 2023-10-03 10:01:53,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d0529af19a6c4d5ce8e9543c089f3431: 2023-10-03 10:01:53,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8be7bca1825beadf4a27319398411182 2023-10-03 10:01:53,123 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8be7bca1825beadf4a27319398411182, regionState=CLOSED 2023-10-03 10:01:53,123 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696327313123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327313123"}]},"ts":"1696327313123"} 2023-10-03 10:01:53,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:53,124 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d0529af19a6c4d5ce8e9543c089f3431, regionState=CLOSED 2023-10-03 10:01:53,124 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696327313124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696327313124"}]},"ts":"1696327313124"} 2023-10-03 10:01:53,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-03 10:01:53,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 8be7bca1825beadf4a27319398411182, server=jenkins-hbase4.apache.org,42977,1696327199993 in 172 msec 2023-10-03 10:01:53,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-03 10:01:53,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure d0529af19a6c4d5ce8e9543c089f3431, server=jenkins-hbase4.apache.org,36133,1696327199942 in 174 msec 2023-10-03 10:01:53,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8be7bca1825beadf4a27319398411182, UNASSIGN in 178 msec 2023-10-03 10:01:53,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-10-03 10:01:53,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d0529af19a6c4d5ce8e9543c089f3431, UNASSIGN in 179 msec 2023-10-03 10:01:53,129 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696327313129"}]},"ts":"1696327313129"} 2023-10-03 10:01:53,130 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-03 10:01:53,132 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-03 10:01:53,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 191 msec 2023-10-03 10:01:53,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-03 10:01:53,246 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-03 10:01:53,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,250 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,251 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,252 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34139] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,254 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:53,254 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182 2023-10-03 10:01:53,256 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/recovered.edits] 2023-10-03 10:01:53,256 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/cf, FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/recovered.edits] 2023-10-03 10:01:53,257 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,257 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,257 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,257 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-03 10:01:53,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-03 10:01:53,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-03 10:01:53,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-03 10:01:53,259 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,259 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:53,259 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,259 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,259 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:53,259 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,259 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:53,259 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-03 10:01:53,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-03 10:01:53,261 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/cf/5c95b305d1b44c42bf00abd537af8a35 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/cf/5c95b305d1b44c42bf00abd537af8a35 2023-10-03 10:01:53,261 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/cf/96505467f41548a98158acfd059d4c0a to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/cf/96505467f41548a98158acfd059d4c0a 2023-10-03 10:01:53,264 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431/recovered.edits/9.seqid 2023-10-03 10:01:53,265 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/recovered.edits/9.seqid to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182/recovered.edits/9.seqid 2023-10-03 10:01:53,265 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d0529af19a6c4d5ce8e9543c089f3431 2023-10-03 10:01:53,265 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8be7bca1825beadf4a27319398411182 2023-10-03 10:01:53,265 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-03 10:01:53,266 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-03 10:01:53,267 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-03 10:01:53,270 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310036d42ee7d264a4d228f00cbf3c2cdd589 to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310036d42ee7d264a4d228f00cbf3c2cdd589 2023-10-03 10:01:53,271 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100397755e3b1b654f5ea9f4f723edf6914d to hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100397755e3b1b654f5ea9f4f723edf6914d 2023-10-03 10:01:53,271 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-03 10:01:53,273 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,275 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-03 10:01:53,277 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-03 10:01:53,278 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,278 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-03 10:01:53,278 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327313278"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:53,278 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696327313278"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:53,280 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-03 10:01:53,280 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d0529af19a6c4d5ce8e9543c089f3431, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696327297957.d0529af19a6c4d5ce8e9543c089f3431.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8be7bca1825beadf4a27319398411182, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696327297957.8be7bca1825beadf4a27319398411182.', STARTKEY => '1', ENDKEY => ''}] 2023-10-03 10:01:53,280 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-03 10:01:53,280 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696327313280"}]},"ts":"9223372036854775807"} 2023-10-03 10:01:53,281 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-03 10:01:53,283 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,284 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 36 msec 2023-10-03 10:01:53,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-03 10:01:53,362 INFO [Listener at jenkins-hbase4.apache.org/39739] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-03 10:01:53,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-03 10:01:53,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-03 10:01:53,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-03 10:01:53,400 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 766) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5335 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:55696 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1067272365_1 at /127.0.0.1:55660 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48161bf2-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:54288 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-839168187_17 at /127.0.0.1:44360 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:33379 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=919 (was 942), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=233 (was 239), ProcessCount=168 (was 168), AvailableMemoryMB=7770 (was 7874) 2023-10-03 10:01:53,400 WARN [Listener at jenkins-hbase4.apache.org/39739] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-03 10:01:53,400 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-03 10:01:53,411 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-03 10:01:57,797 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696327206317_0007_000001 (auth:SIMPLE) 2023-10-03 10:01:58,688 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-03 10:02:07,533 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-03 10:02:21,665 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-03 10:02:21,666 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-03 10:02:21,775 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-03 10:02:21,781 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-03 10:02:21,782 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-03 10:02:21,788 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-03 10:02:21,891 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-03 10:02:21,891 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-03 10:02:21,891 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-03 10:02:21,891 INFO [Listener at jenkins-hbase4.apache.org/39739] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-03 10:02:21,892 DEBUG [Listener at jenkins-hbase4.apache.org/39739] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d73dc0e to 127.0.0.1:56716 2023-10-03 10:02:21,892 DEBUG [Listener at jenkins-hbase4.apache.org/39739] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:02:21,892 DEBUG [Listener at jenkins-hbase4.apache.org/39739] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-03 10:02:21,892 DEBUG [Listener at jenkins-hbase4.apache.org/39739] util.JVMClusterUtil(257): Found active master hash=726229391, stopped=false 2023-10-03 10:02:21,892 DEBUG [Listener at jenkins-hbase4.apache.org/39739] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:02:21,892 DEBUG [Listener at jenkins-hbase4.apache.org/39739] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-03 10:02:21,892 INFO [Listener at jenkins-hbase4.apache.org/39739] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33857,1696327198658 2023-10-03 10:02:21,894 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-03 10:02:21,894 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-03 10:02:21,894 INFO [Listener at jenkins-hbase4.apache.org/39739] procedure2.ProcedureExecutor(628): Stopping 2023-10-03 10:02:21,894 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-03 10:02:21,894 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-03 10:02:21,894 DEBUG [Listener at jenkins-hbase4.apache.org/39739] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34e730b6 to 127.0.0.1:56716 2023-10-03 10:02:21,894 DEBUG [Listener at jenkins-hbase4.apache.org/39739] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:02:21,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-03 10:02:21,894 INFO [Listener at jenkins-hbase4.apache.org/39739] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36133,1696327199942' ***** 2023-10-03 10:02:21,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-03 10:02:21,895 DEBUG [Listener at jenkins-hbase4.apache.org/39739] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:02:21,895 INFO [Listener at jenkins-hbase4.apache.org/39739] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-03 10:02:21,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-03 10:02:21,894 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:02:21,895 INFO [Listener at jenkins-hbase4.apache.org/39739] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42977,1696327199993' ***** 2023-10-03 10:02:21,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-03 10:02:21,895 DEBUG [Listener at jenkins-hbase4.apache.org/39739] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:02:21,895 INFO [RS:0;jenkins-hbase4:36133] regionserver.HeapMemoryManager(220): Stopping 2023-10-03 10:02:21,895 INFO [Listener at jenkins-hbase4.apache.org/39739] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-03 10:02:21,895 INFO [Listener at jenkins-hbase4.apache.org/39739] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34139,1696327200029' ***** 2023-10-03 10:02:21,895 INFO [RS:0;jenkins-hbase4:36133] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-03 10:02:21,895 INFO [RS:1;jenkins-hbase4:42977] regionserver.HeapMemoryManager(220): Stopping 2023-10-03 10:02:21,895 DEBUG [Listener at jenkins-hbase4.apache.org/39739] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:02:21,895 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-03 10:02:21,895 INFO [RS:1;jenkins-hbase4:42977] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-03 10:02:21,895 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-03 10:02:21,896 INFO [RS:1;jenkins-hbase4:42977] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-03 10:02:21,895 INFO [RS:0;jenkins-hbase4:36133] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-03 10:02:21,896 INFO [Listener at jenkins-hbase4.apache.org/39739] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-03 10:02:21,896 INFO [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:02:21,896 DEBUG [RS:1;jenkins-hbase4:42977] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74cbd7c9 to 127.0.0.1:56716 2023-10-03 10:02:21,896 INFO [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(3305): Received CLOSE for e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:02:21,896 INFO [RS:2;jenkins-hbase4:34139] regionserver.HeapMemoryManager(220): Stopping 2023-10-03 10:02:21,896 DEBUG [RS:1;jenkins-hbase4:42977] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:02:21,896 INFO [RS:2;jenkins-hbase4:34139] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-03 10:02:21,899 INFO [RS:2;jenkins-hbase4:34139] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-03 10:02:21,899 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-03 10:02:21,899 INFO [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:02:21,899 INFO [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(3305): Received CLOSE for 5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:02:21,899 INFO [RS:1;jenkins-hbase4:42977] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-03 10:02:21,899 INFO [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:02:21,899 INFO [RS:1;jenkins-hbase4:42977] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-03 10:02:21,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e57de513a367d2c9e92fb7aae5f16a5c, disabling compactions & flushes 2023-10-03 10:02:21,899 DEBUG [RS:0;jenkins-hbase4:36133] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2996d17a to 127.0.0.1:56716 2023-10-03 10:02:21,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:02:21,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5cf1c177e5714ffebd72cf3b7a71e928, disabling compactions & flushes 2023-10-03 10:02:21,900 INFO [RS:1;jenkins-hbase4:42977] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-03 10:02:21,899 DEBUG [RS:2;jenkins-hbase4:34139] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50ff074d to 127.0.0.1:56716 2023-10-03 10:02:21,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:02:21,900 INFO [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-03 10:02:21,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:02:21,900 DEBUG [RS:0;jenkins-hbase4:36133] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:02:21,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. after waiting 0 ms 2023-10-03 10:02:21,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:02:21,901 INFO [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-03 10:02:21,901 INFO [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-03 10:02:21,900 DEBUG [RS:2;jenkins-hbase4:34139] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:02:21,901 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1478): Online Regions={e57de513a367d2c9e92fb7aae5f16a5c=hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c.} 2023-10-03 10:02:21,901 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-03 10:02:21,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. after waiting 0 ms 2023-10-03 10:02:21,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:02:21,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:02:21,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e57de513a367d2c9e92fb7aae5f16a5c 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-03 10:02:21,902 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-03 10:02:21,901 INFO [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-03 10:02:21,902 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-03 10:02:21,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5cf1c177e5714ffebd72cf3b7a71e928 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-03 10:02:21,902 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-03 10:02:21,902 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1478): Online Regions={5cf1c177e5714ffebd72cf3b7a71e928=hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928.} 2023-10-03 10:02:21,902 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-03 10:02:21,902 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-03 10:02:21,903 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-03 10:02:21,903 DEBUG [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-03 10:02:21,903 DEBUG [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1504): Waiting on 5cf1c177e5714ffebd72cf3b7a71e928 2023-10-03 10:02:21,903 DEBUG [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1504): Waiting on e57de513a367d2c9e92fb7aae5f16a5c 2023-10-03 10:02:21,908 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-03 10:02:21,915 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-03 10:02:21,917 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-03 10:02:21,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928/.tmp/l/dbcbdf6c99ce43c7a6a5060c2a308c7e 2023-10-03 10:02:21,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c/.tmp/info/a71a52da0eb44ac49c6e52e179181a07 2023-10-03 10:02:21,935 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/.tmp/info/badb9a16e4fe4b1dbf7f2b38a74791f1 2023-10-03 10:02:21,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbcbdf6c99ce43c7a6a5060c2a308c7e 2023-10-03 10:02:21,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c/.tmp/info/a71a52da0eb44ac49c6e52e179181a07 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c/info/a71a52da0eb44ac49c6e52e179181a07 2023-10-03 10:02:21,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928/.tmp/l/dbcbdf6c99ce43c7a6a5060c2a308c7e as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928/l/dbcbdf6c99ce43c7a6a5060c2a308c7e 2023-10-03 10:02:21,939 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for badb9a16e4fe4b1dbf7f2b38a74791f1 2023-10-03 10:02:21,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c/info/a71a52da0eb44ac49c6e52e179181a07, entries=2, sequenceid=6, filesize=4.8 K 2023-10-03 10:02:21,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbcbdf6c99ce43c7a6a5060c2a308c7e 2023-10-03 10:02:21,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928/l/dbcbdf6c99ce43c7a6a5060c2a308c7e, entries=7, sequenceid=18, filesize=5.2 K 2023-10-03 10:02:21,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 5cf1c177e5714ffebd72cf3b7a71e928 in 43ms, sequenceid=18, compaction requested=false 2023-10-03 10:02:21,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e57de513a367d2c9e92fb7aae5f16a5c in 47ms, sequenceid=6, compaction requested=false 2023-10-03 10:02:21,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/acl/5cf1c177e5714ffebd72cf3b7a71e928/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-03 10:02:21,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:02:21,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:02:21,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5cf1c177e5714ffebd72cf3b7a71e928: 2023-10-03 10:02:21,954 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/.tmp/rep_barrier/e6c196727f7f475eb88befc22a1395f5 2023-10-03 10:02:21,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696327202862.5cf1c177e5714ffebd72cf3b7a71e928. 2023-10-03 10:02:21,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/namespace/e57de513a367d2c9e92fb7aae5f16a5c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-03 10:02:21,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:02:21,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:02:21,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e57de513a367d2c9e92fb7aae5f16a5c: 2023-10-03 10:02:21,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696327202102.e57de513a367d2c9e92fb7aae5f16a5c. 2023-10-03 10:02:21,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6c196727f7f475eb88befc22a1395f5 2023-10-03 10:02:21,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/.tmp/table/3d1808be2aea450dac69b1729f635a47 2023-10-03 10:02:21,972 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d1808be2aea450dac69b1729f635a47 2023-10-03 10:02:21,972 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/.tmp/info/badb9a16e4fe4b1dbf7f2b38a74791f1 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/info/badb9a16e4fe4b1dbf7f2b38a74791f1 2023-10-03 10:02:21,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for badb9a16e4fe4b1dbf7f2b38a74791f1 2023-10-03 10:02:21,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/info/badb9a16e4fe4b1dbf7f2b38a74791f1, entries=48, sequenceid=131, filesize=10.3 K 2023-10-03 10:02:21,977 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/.tmp/rep_barrier/e6c196727f7f475eb88befc22a1395f5 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/rep_barrier/e6c196727f7f475eb88befc22a1395f5 2023-10-03 10:02:21,981 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6c196727f7f475eb88befc22a1395f5 2023-10-03 10:02:21,981 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/rep_barrier/e6c196727f7f475eb88befc22a1395f5, entries=13, sequenceid=131, filesize=6.4 K 2023-10-03 10:02:21,982 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/.tmp/table/3d1808be2aea450dac69b1729f635a47 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/table/3d1808be2aea450dac69b1729f635a47 2023-10-03 10:02:21,986 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d1808be2aea450dac69b1729f635a47 2023-10-03 10:02:21,986 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/table/3d1808be2aea450dac69b1729f635a47, entries=24, sequenceid=131, filesize=6.9 K 2023-10-03 10:02:21,987 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 85ms, sequenceid=131, compaction requested=false 2023-10-03 10:02:21,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-03 10:02:21,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-03 10:02:21,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-03 10:02:21,997 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-03 10:02:21,997 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-03 10:02:21,997 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-03 10:02:22,103 INFO [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42977,1696327199993; all regions closed. 2023-10-03 10:02:22,103 INFO [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36133,1696327199942; all regions closed. 2023-10-03 10:02:22,103 INFO [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34139,1696327200029; all regions closed. 2023-10-03 10:02:22,116 DEBUG [RS:1;jenkins-hbase4:42977] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/oldWALs 2023-10-03 10:02:22,116 INFO [RS:1;jenkins-hbase4:42977] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42977%2C1696327199993.meta:.meta(num 1696327201814) 2023-10-03 10:02:22,116 DEBUG [RS:0;jenkins-hbase4:36133] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/oldWALs 2023-10-03 10:02:22,116 INFO [RS:0;jenkins-hbase4:36133] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36133%2C1696327199942:(num 1696327201707) 2023-10-03 10:02:22,116 DEBUG [RS:0;jenkins-hbase4:36133] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:02:22,116 INFO [RS:0;jenkins-hbase4:36133] regionserver.LeaseManager(133): Closed leases 2023-10-03 10:02:22,117 INFO [RS:0;jenkins-hbase4:36133] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-03 10:02:22,117 INFO [RS:0;jenkins-hbase4:36133] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-03 10:02:22,117 INFO [RS:0;jenkins-hbase4:36133] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-03 10:02:22,117 INFO [RS:0;jenkins-hbase4:36133] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-03 10:02:22,117 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-03 10:02:22,119 INFO [RS:0;jenkins-hbase4:36133] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36133 2023-10-03 10:02:22,121 DEBUG [RS:2;jenkins-hbase4:34139] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/oldWALs 2023-10-03 10:02:22,121 INFO [RS:2;jenkins-hbase4:34139] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34139%2C1696327200029:(num 1696327201707) 2023-10-03 10:02:22,121 DEBUG [RS:2;jenkins-hbase4:34139] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:02:22,121 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/WALs/jenkins-hbase4.apache.org,42977,1696327199993/jenkins-hbase4.apache.org%2C42977%2C1696327199993.1696327201707 not finished, retry = 0 2023-10-03 10:02:22,121 INFO [RS:2;jenkins-hbase4:34139] regionserver.LeaseManager(133): Closed leases 2023-10-03 10:02:22,121 INFO [RS:2;jenkins-hbase4:34139] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-03 10:02:22,122 INFO [RS:2;jenkins-hbase4:34139] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-03 10:02:22,122 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-03 10:02:22,122 INFO [RS:2;jenkins-hbase4:34139] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-03 10:02:22,122 INFO [RS:2;jenkins-hbase4:34139] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-03 10:02:22,123 INFO [RS:2;jenkins-hbase4:34139] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34139 2023-10-03 10:02:22,127 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:02:22,127 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-03 10:02:22,127 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-03 10:02:22,127 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:02:22,127 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34139,1696327200029 2023-10-03 10:02:22,127 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-03 10:02:22,127 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-03 10:02:22,127 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:02:22,127 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:02:22,127 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36133,1696327199942 2023-10-03 10:02:22,129 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34139,1696327200029] 2023-10-03 10:02:22,130 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34139,1696327200029; numProcessing=1 2023-10-03 10:02:22,131 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34139,1696327200029 already deleted, retry=false 2023-10-03 10:02:22,131 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34139,1696327200029 expired; onlineServers=2 2023-10-03 10:02:22,131 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36133,1696327199942] 2023-10-03 10:02:22,131 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36133,1696327199942; numProcessing=2 2023-10-03 10:02:22,132 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36133,1696327199942 already deleted, retry=false 2023-10-03 10:02:22,132 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36133,1696327199942 expired; onlineServers=1 2023-10-03 10:02:22,223 DEBUG [RS:1;jenkins-hbase4:42977] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/oldWALs 2023-10-03 10:02:22,223 INFO [RS:1;jenkins-hbase4:42977] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42977%2C1696327199993:(num 1696327201707) 2023-10-03 10:02:22,223 DEBUG [RS:1;jenkins-hbase4:42977] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:02:22,223 INFO [RS:1;jenkins-hbase4:42977] regionserver.LeaseManager(133): Closed leases 2023-10-03 10:02:22,224 INFO [RS:1;jenkins-hbase4:42977] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-03 10:02:22,224 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-03 10:02:22,225 INFO [RS:1;jenkins-hbase4:42977] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42977 2023-10-03 10:02:22,227 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42977,1696327199993 2023-10-03 10:02:22,227 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-03 10:02:22,229 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42977,1696327199993] 2023-10-03 10:02:22,229 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42977,1696327199993; numProcessing=3 2023-10-03 10:02:22,229 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-03 10:02:22,229 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:34139-0x1010bba1bd60003, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-03 10:02:22,229 INFO [RS:2;jenkins-hbase4:34139] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34139,1696327200029; zookeeper connection closed. 2023-10-03 10:02:22,230 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42977,1696327199993 already deleted, retry=false 2023-10-03 10:02:22,230 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42977,1696327199993 expired; onlineServers=0 2023-10-03 10:02:22,230 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33857,1696327198658' ***** 2023-10-03 10:02:22,230 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-03 10:02:22,230 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4123c31a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4123c31a 2023-10-03 10:02:22,230 DEBUG [M:0;jenkins-hbase4:33857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a746bb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-03 10:02:22,230 INFO [M:0;jenkins-hbase4:33857] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33857,1696327198658 2023-10-03 10:02:22,230 INFO [M:0;jenkins-hbase4:33857] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33857,1696327198658; all regions closed. 2023-10-03 10:02:22,230 DEBUG [M:0;jenkins-hbase4:33857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-03 10:02:22,230 DEBUG [M:0;jenkins-hbase4:33857] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-03 10:02:22,230 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-03 10:02:22,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696327201245] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696327201245,5,FailOnTimeoutGroup] 2023-10-03 10:02:22,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696327201244] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696327201244,5,FailOnTimeoutGroup] 2023-10-03 10:02:22,230 DEBUG [M:0;jenkins-hbase4:33857] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-03 10:02:22,231 INFO [M:0;jenkins-hbase4:33857] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-03 10:02:22,231 INFO [M:0;jenkins-hbase4:33857] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-03 10:02:22,231 INFO [M:0;jenkins-hbase4:33857] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-03 10:02:22,231 DEBUG [M:0;jenkins-hbase4:33857] master.HMaster(1512): Stopping service threads 2023-10-03 10:02:22,231 INFO [M:0;jenkins-hbase4:33857] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-03 10:02:22,231 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-03 10:02:22,231 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-03 10:02:22,231 ERROR [M:0;jenkins-hbase4:33857] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-03 10:02:22,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-03 10:02:22,232 INFO [M:0;jenkins-hbase4:33857] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-03 10:02:22,232 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-03 10:02:22,232 DEBUG [M:0;jenkins-hbase4:33857] zookeeper.ZKUtil(398): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-03 10:02:22,232 WARN [M:0;jenkins-hbase4:33857] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-03 10:02:22,232 INFO [M:0;jenkins-hbase4:33857] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-03 10:02:22,233 INFO [M:0;jenkins-hbase4:33857] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-03 10:02:22,233 DEBUG [M:0;jenkins-hbase4:33857] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-03 10:02:22,233 INFO [M:0;jenkins-hbase4:33857] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-03 10:02:22,233 DEBUG [M:0;jenkins-hbase4:33857] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-03 10:02:22,233 DEBUG [M:0;jenkins-hbase4:33857] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-03 10:02:22,233 DEBUG [M:0;jenkins-hbase4:33857] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-03 10:02:22,234 INFO [M:0;jenkins-hbase4:33857] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.14 KB 2023-10-03 10:02:22,248 INFO [M:0;jenkins-hbase4:33857] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c93d1e26fc3d411a9c9907462a3f8b51 2023-10-03 10:02:22,251 INFO [M:0;jenkins-hbase4:33857] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c93d1e26fc3d411a9c9907462a3f8b51 2023-10-03 10:02:22,252 DEBUG [M:0;jenkins-hbase4:33857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c93d1e26fc3d411a9c9907462a3f8b51 as hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c93d1e26fc3d411a9c9907462a3f8b51 2023-10-03 10:02:22,256 INFO [M:0;jenkins-hbase4:33857] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c93d1e26fc3d411a9c9907462a3f8b51 2023-10-03 10:02:22,256 INFO [M:0;jenkins-hbase4:33857] regionserver.HStore(1080): Added hdfs://localhost:36071/user/jenkins/test-data/4a515572-3094-7ec1-da89-9a93567d9ead/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c93d1e26fc3d411a9c9907462a3f8b51, entries=119, sequenceid=899, filesize=28.7 K 2023-10-03 10:02:22,257 INFO [M:0;jenkins-hbase4:33857] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384910, heapSize ~452.13 KB/462976, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-10-03 10:02:22,258 INFO [M:0;jenkins-hbase4:33857] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-03 10:02:22,258 DEBUG [M:0;jenkins-hbase4:33857] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-03 10:02:22,261 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-03 10:02:22,261 INFO [M:0;jenkins-hbase4:33857] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-03 10:02:22,262 INFO [M:0;jenkins-hbase4:33857] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33857 2023-10-03 10:02:22,265 DEBUG [M:0;jenkins-hbase4:33857] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33857,1696327198658 already deleted, retry=false 2023-10-03 10:02:22,330 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-03 10:02:22,330 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:42977-0x1010bba1bd60002, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-03 10:02:22,330 INFO [RS:1;jenkins-hbase4:42977] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42977,1696327199993; zookeeper connection closed. 2023-10-03 10:02:22,330 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@87bbacd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@87bbacd 2023-10-03 10:02:22,430 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-03 10:02:22,430 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): regionserver:36133-0x1010bba1bd60001, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-03 10:02:22,430 INFO [RS:0;jenkins-hbase4:36133] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36133,1696327199942; zookeeper connection closed. 2023-10-03 10:02:22,430 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@67763307] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@67763307 2023-10-03 10:02:22,430 INFO [Listener at jenkins-hbase4.apache.org/39739] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-03 10:02:22,530 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-03 10:02:22,530 INFO [M:0;jenkins-hbase4:33857] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33857,1696327198658; zookeeper connection closed. 2023-10-03 10:02:22,530 DEBUG [Listener at localhost/46481-EventThread] zookeeper.ZKWatcher(600): master:33857-0x1010bba1bd60000, quorum=127.0.0.1:56716, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-03 10:02:22,532 WARN [Listener at jenkins-hbase4.apache.org/39739] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-03 10:02:22,534 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-03 10:02:22,638 WARN [BP-566219557-172.31.14.131-1696327195303 heartbeating to localhost/127.0.0.1:36071] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-03 10:02:22,638 WARN [BP-566219557-172.31.14.131-1696327195303 heartbeating to localhost/127.0.0.1:36071] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-566219557-172.31.14.131-1696327195303 (Datanode Uuid 325f566a-8c2b-4c0f-bc93-5013b3963475) service to localhost/127.0.0.1:36071 2023-10-03 10:02:22,639 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data5/current/BP-566219557-172.31.14.131-1696327195303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-03 10:02:22,640 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data6/current/BP-566219557-172.31.14.131-1696327195303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-03 10:02:22,640 WARN [Listener at jenkins-hbase4.apache.org/39739] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-03 10:02:22,642 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-03 10:02:22,745 WARN [BP-566219557-172.31.14.131-1696327195303 heartbeating to localhost/127.0.0.1:36071] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-03 10:02:22,745 WARN [BP-566219557-172.31.14.131-1696327195303 heartbeating to localhost/127.0.0.1:36071] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-566219557-172.31.14.131-1696327195303 (Datanode Uuid 1362ae40-ee32-4844-b465-3511f35ded0a) service to localhost/127.0.0.1:36071 2023-10-03 10:02:22,745 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data3/current/BP-566219557-172.31.14.131-1696327195303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-03 10:02:22,746 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data4/current/BP-566219557-172.31.14.131-1696327195303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-03 10:02:22,746 WARN [Listener at jenkins-hbase4.apache.org/39739] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-03 10:02:22,748 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-03 10:02:22,852 WARN [BP-566219557-172.31.14.131-1696327195303 heartbeating to localhost/127.0.0.1:36071] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-03 10:02:22,852 WARN [BP-566219557-172.31.14.131-1696327195303 heartbeating to localhost/127.0.0.1:36071] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-566219557-172.31.14.131-1696327195303 (Datanode Uuid 0b14d6ff-d02e-440e-bb0f-ee667635274a) service to localhost/127.0.0.1:36071 2023-10-03 10:02:22,853 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data1/current/BP-566219557-172.31.14.131-1696327195303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-03 10:02:22,853 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8511ef10-f89a-7d30-a716-5a0cb2b6f9b8/cluster_4197bde9-00a0-3c4e-9fbb-0bdb466183f8/dfs/data/data2/current/BP-566219557-172.31.14.131-1696327195303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-03 10:02:22,873 INFO [Listener at jenkins-hbase4.apache.org/39739] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-03 10:02:22,999 INFO [Listener at jenkins-hbase4.apache.org/39739] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-03 10:02:23,089 INFO [Listener at jenkins-hbase4.apache.org/39739] hbase.HBaseTestingUtility(1293): Minicluster is down